The ideal candidate will be specializing in AWS MSK/Apache Kafka/Confluent Kafka development. The role involves strategizing and implementing large-scale data solutions across various cloud platforms, managing data integration, and ensuring seamless data migration and consistency. The candidate will also translate functional requirements into technical specifications, implement observability solutions, and collaborate closely with stakeholders and engineers.
Responsibilities
- Design and execute data warehouses and application pipelines for cloud platforms (AWS, GCP, Azure, Snowflake, BigQuery).
- Develop and deliver POCs to standardize data movement and consumption patterns.
- Translate functional requirements into detailed technical specifications for ETL development.
- Implement application performance monitoring, infrastructure monitoring, log analytics, and event management using AIOps and MLOps.
- Utilize various Big Data technologies for data streaming, programming, SQL/NoSQL, and visualization tools.
- Design, develop, and deploy scalable and reliable systems to handle high volumes of data.
- Identify and resolve data migration issues, ensuring data consistency and meeting business requirements.
Required Experience
- 8+ years of professional experience as an AWS MSK/Apache Kafka/Confluent Kafka developer with a deep understanding of Kafka development.
- Strong knowledge of Kafka internals, Java, Spring Boot, and related technologies.
- Experience or working knowledge of AWS technologies including ECS/EKS, Lambda, API Gateway, S3, Terraform, and Kafka.
- Sound knowledge of authorization and authentication approaches like OAuth, and SSO/SAML.
- Experience with build tools like Maven, and Gradle, and unit test tools like JUnit and Mockito.
- experience with service orchestration and messaging technology, including Kafka governance.
- Experience with Agile development methodologies.