We are looking for an experienced GCP Big Data Engineer with 5–8 years of experience in designing, developing, and managing scalable data solutions on Google Cloud Platform (GCP). The ideal candidate should have strong expertise in Big Data technologies, ETL development, data pipeline engineering, and cloud-based data processing.
The candidate will be responsible for building and optimizing large-scale data pipelines using GCP services such as BigQuery, Dataflow, Dataproc, and Cloud Storage. This role requires strong hands-on development skills, the ability to lead development modules, and experience working directly with clients to deliver scalable data solutions.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes on Google Cloud Platform.
- Build and manage large-scale data processing solutions using BigQuery, Dataflow, Dataproc, and Cloud Storage.
- Develop and optimize data integration workflows to support business intelligence, analytics, and reporting requirements.
- Implement efficient data processing solutions using appropriate Big Data frameworks and technologies.
- Optimize data pipelines, SQL queries, and data processing workflows for performance, scalability, and reliability.
- Lead individual development modules and take ownership of end-to-end development activities.
- Work directly with clients to understand business requirements, provide technical solutions, and deliver project milestones.
- Collaborate with cross-functional teams to ensure seamless data integration and successful project delivery.
- Troubleshoot data pipeline issues, perform root cause analysis, and implement effective solutions.
- Follow best practices for data quality, security, performance optimization, and cloud-based data engineering.
Required Skills
- 5–8 years of experience in Big Data Engineering and data pipeline development.
- Strong hands-on experience with Google Cloud Platform (GCP).
- Expertise in BigQuery, Dataflow, Dataproc, and Cloud Storage.
- Strong experience in ETL development, data integration, and large-scale data processing.
- Experience designing, developing, and maintaining scalable data pipelines.
- Strong knowledge of SQL, data transformation, and performance optimization.
- Experience with Big Data processing frameworks and cloud-based data solutions.
- Ability to work independently and lead development modules.
- Strong analytical, problem-solving, and debugging skills.
Nice-to-Have Skills
- Experience working directly with clients and business stakeholders.
- Excellent verbal and written communication skills.
- Ability to explain complex technical concepts to business and technical teams.
- Experience working in Agile development environments.