Key Responsibilities

• Responsible for designing, developing, and maintaining big data applications using the Hadoop ecosystem
• Requirements Gathering and design
• Creating data processing framework based on Spark with Java.
• Process and analyze large volumes of structured and unstructured data using Hadoop and related tools
• Optimize the performance of Hadoop applications by tuning configurations, optimizing data storage and retrieval, and implementing efficient data processing techniques.

 

Required Qualifications

• Good understanding of Hadoop concepts including file system and Map Reduce.
• Hands on experience on Spark framework, Unix scripting, Hive queries, writing UDF in Hive. Theoretical knowledge and POC alone will not suffice.
• Good knowledge in Software Development Life Cycle and Project Development Lifecycle.
• Associate should be able to work independently and should have strong debugging skill in both Hive and Spark.
• Associate should have experience developing large scale systems, experience debugging and performance tuning, excellent software design skills, communication skills and ability to work with client partners.