Roles & Responsibilities

• Handle customer queries and provide timely support to address Kafka-related issues and concerns.
• Ensure Kafka infrastructure support availability during standard business hours, as well as 24/7 support availability during rotational on-call periods.
• Develop and maintain automation scripts to optimize and streamline Kafka infrastructure management.
• Proactively troubleshoot Kafka-related issues and optimize the performance of the Kafka clusters to ensure high availability and reliability.
• Work closely with other teams to integrate Kafka with various big data systems and ensure smooth data flows across platforms.

Required Experience

• Proven experience in designing, developing, and managing Kafka-based data pipelines.
• Familiarity with other big data technologies such as Hadoop, Spark, and Storm.
• Strong experience in monitoring, optimizing, and troubleshooting Kafka clusters.
• Ability to provide 3rd-level administrator support for Kafka infrastructure, resolving complex issues.
• Ensuring the availability, performance, and security of Kafka systems.
• Creating and managing Kafka topics, producers, and consumers, including Python-based Kafka consumers and producers to enable efficient data exchange between systems.

Posted By