The GCP Data Engineer will be responsible for designing, developing, and deploying data pipelines and processes within Google Cloud Platform (GCP). This role is pivotal in upgrading GCP infrastructure and ensuring smooth operation of both batch and real-time data ingestion pipelines. The engineer will work across different teams, collaborate with offshore resources, and be self-sufficient in driving projects forward. The position requires strong technical skills in GCP and related technologies, with a focus on data pipeline development, cloud storage, and Python scripting.

Requirements

• Bachelor’s degree in computer science, Engineering, or a related field.
• 8+ years of experience in data engineering, with a focus on GCP technologies.
• Proficiency in GCP services, including Dataflow, Dataproc, Pub/Sub, BigQuery, and Cloud Storage.
• Experience in building and maintaining data pipelines using Python and Spark.
• Strong experience with BigQuery including SQL and Stored Procedures.
• Hands-on experience with real-time ingestion frameworks like Kafka or similar.
• Experience with Spark on GCP (Dataproc) and strong Python scripting skills.
• Familiarity with REST APIs and microservices architecture.
• Experience with high-volume data processing (GB-level).
• Previous experience working in a similar role with GCP stack technologies.

Posted By