Key Responsibilities

• Lead Kafka capacity planning, installation, and platform management. Oversee Kafka clusters, partitioning, broker performance, and data replication.
• Deploy and manage Confluent Kafka clusters across cloud and on-premise environments. Handle installation, configuration, and troubleshooting.
• Optimize Kafka partitioning and broker performance across producers, brokers, and consumers to ensure efficiency and scalability.
• Build and configure Kafka producer applications and manage data pipelines for real-time event processing.
• Set up monitoring for Kafka services and alerting for critical metrics to ensure system reliability.
• Collaborate on architectural design, propose improvements, and lead R&D efforts to explore new Kafka features.
• Work with Project Managers and technical teams to define project plans and provide guidance to junior engineers.
• Develop and enforce best practices, maintain documentation, and ensure adherence to enterprise architectural standards.

Required Qualifications

• Extensive experience in Confluent Kafka deployment, administration, and performance optimization.
• Strong understanding of Kafka architecture, including clusters, partitions, brokers, and producers.
• Hands-on experience with Kafka security, disaster recovery, and data replication strategies.
• Expertise in configuring Kafka connectors and integrating Kafka with external systems.
• Proven experience in cloud-based Kafka environments (AWS, Azure, GCP) and on-premise Kafka clusters.
• Proficiency in monitoring tools such as Prometheus, Grafana, and Confluent Control Center.
• Ability to optimize Kafka performance at multiple levels: producer, broker, and consumer.
• Strong troubleshooting skills and experience with Kafka-related issues, both in development and production environments.

Posted By