Roles & Responsibilities

• Design, implement, and maintain Kafka pipelines: brokers, producers, consumers, topics, partitions, offsets
• Work with Hadoop ecosystem for data storage, processing, and optimization
• Performance tuning of Kafka and Hadoop workflows
• Collaborate in Agile teams using Jira and Confluence
• Support CI/CD deployments and version control using Git/Bitbucket
• Assist with data processing solutions and integration with other systems

Additional Requirements

• Strong problem-solving skills and ability to troubleshoot production issues
• Hands-on experience in data streaming, big data processing, and pipeline optimization

Primary Skills: Kafka (configurations, monitoring, deployments) , Hadoop Ecosystem (HDFS, MapReduce, performance tuning)

Secondary Skills: Mulesoft, Spark with Scala/Java, Shell scripting

Posted By