Key Responsibilities

• Design and develop ETL/ELT processes to extract, transform, and load data from various sources into data warehouses and big data platforms.
• Build robust data models and pipelines that effectively process and manage large datasets.
• Utilize cloud technologies, specifically Google Cloud Platform (GCP) and BigQuery, to develop and manage data warehousing solutions.
• Implement and optimize big data solutions to handle complex data processing requirements.
• Write complex SQL queries to analyze and manipulate data, translating business requirements into actionable insights.
• Utilize programming languages such as Java or Python to develop data processing applications.
• Leverage GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Composer) for data processing and orchestration.
• Utilize Google Cloud SDK and API scripting for automating and managing cloud resources.
• Coordinate effectively between onsite and offshore teams to ensure project alignment and timely delivery.
• Engage in Test Driven Development (TDD) practices to ensure high-quality code and robust data solutions.
• Participate in Agile processes and apply DevOps methodologies to streamline development workflows.

Required Experience/Skills

• Minimum of 8 years in ETL/ELT, data warehousing, and big data solutions.
• At least 5 years in building data models and data pipelines for large datasets.
• Proficient in SQL, capable of handling complex query scenarios.
• Strong programming experience in Java or Python.
• Familiarity with CI/CD tools such as GitHub and Jenkins.
• Knowledge of NoSQL databases is an advantage.
• Experience in the retail domain is a plus.
• Google Cloud Professional Data Engineer certification is preferred.
• Strong experience with Google Cloud Platform, particularly with BigQuery and Dataflow. Experience with AWS is a plus.

Posted By