Primary Responsibilities

• Design and implement enterprise-grade Kafka solutions using Confluent Platform and Confluent Cloud, ensuring high performance, scalability, and reliability.
• Architect and manage Kafka clusters, brokers, topics, and partitions, optimizing for performance, high availability, and fault tolerance.
• Lead migration efforts from legacy messaging systems (e.g., IBM MQ, TIBCO) to Apache Kafka, ensuring minimal downtime and smooth transitions.
• Develop and optimize Kafka Streams, ksqlDB, and Kafka Connect pipelines for real-time data processing and integration with various systems.
• Ensure Kafka environments are highly available, with robust disaster recovery plans. Implement and manage security (RBAC, ACLs) and access control for Kafka infrastructure.
• Work closely with data engineering, DevOps, and application teams to integrate Kafka seamlessly into broader enterprise systems and workflows.
• Use tools like Grafana, Prometheus, and Confluent Control Center to monitor Kafka performance, troubleshoot issues, and optimize systems.

Required Skills & Experience

• 8+ years in Kafka architecture and implementation, with proven experience designing and managing Kafka-based solutions in complex environments.
• Extensive experience with Apache Kafka, Confluent Platform, and Confluent Cloud, as well as tools like Kafka Connect, Kafka Streams, and ksqlDB.
• Experience with cloud platforms such as AWS, GCP, or Azure, with a strong understanding of cloud-native architectures and CI/CD pipelines.
• Strong background in data integration tools such as Snowflake, Databricks, or Hadoop.
• Familiarity with scripting languages like Shell or Python and tools like Terraform for infrastructure automation.
• Experience in financial services or credit unions is highly preferred.

Preferred Certifications

• Confluent Certified Developer for Apache Kafka (CCDAK)
• Confluent Certified Administrator for Apache Kafka
• AWS/GCP Cloud Certifications
• ITIL Foundation

Posted By