We are seeking an experienced Hadoop Engineer with hands-on expertise in Big Data ecosystems, including Hadoop, Kafka, and HBase. The role involves administration, performance tuning, and supporting cloud-based Hadoop platforms to ensure reliable, high-performing data solutions for customers.
Required Technical / Functional Skills
- Big Data and Hadoop Ecosystem (HDFS, Hive, Spark, YARN)
- Kafka for real-time data streaming
- HBase for NoSQL data management
- Experience with Cloud Era, AWS, and Hortonworks HDP/HDInsight
Roles & Responsibilities
- Perform Hadoop administration and support HDInsight product teams.
- Provide end-customer support by resolving incidents and ICMs.
- Run prototypes and migrate Big Data workloads.
- Optimize and tune performance for Spark, Hive, and Hadoop jobs.
- Troubleshoot production issues, identify root causes, and implement mitigations.
- Build tools and services to improve debuggability and supportability.
- Monitor cluster health and ensure availability for top customers.
- Collaborate with internal teams to improve processes and operational efficiency.
Preferred Skills
- Strong problem-solving and analytical skills.
- Experience with cloud-based Big Data deployments and cluster management.
- Ability to work closely with product and customer teams to resolve complex issues.