Roles & Responsibilities

• Develop efficient and scalable data pipelines to integrate data across diverse systems.
• Create robust ETL workflows to extract, transform, and load data for business use.
• Establish measures and processes to validate and maintain data quality.
• Work closely with cross-functional data teams to align on integration and architecture goals.
• Continuously enhance data pipeline performance and efficiency.
• Ensure the implementation of security protocols to protect data integrity and compliance with regulations.

Technical/Functional Skills

• Proficiency in workflow, batch, and ETL processes using tools/technologies such as Databricks, Kafka, Streamsets, and Prefect.
• Experience with Docker and Kubernetes for deploying and managing data applications.
• In-depth knowledge of cloud services, including Google Cloud and Microsoft Azure, for data storage, processing, and integration services.
• Expertise in both SQL and NoSQL databases, including MySQL, PostgreSQL, MongoDB, and Cassandra
• Extensive technical expertise to effectively manage and integrate data across various systems and platforms.

Posted By