We are seeking an experienced Technology Lead specializing in ETL development, data transformation, and data quality, with strong hands-on expertise in Snowflake, DBT, AWS Glue, and AWS Lambda.
Key Responsibilities
- Design, develop, implement, and maintain end-to-end ETL pipelines using AWS Glue and other ETL technologies.
- Build and manage data transformation workflows using DBT and Snowflake.
- Develop and maintain AWS Lambda functions to support data processing, automation, and event-driven workflows.
- Implement scalable and reliable data integration solutions using AWS services.
- Develop complex SQL queries for data extraction, transformation, validation, and performance optimization.
- Implement data quality checks and ensure accuracy, consistency, and reliability across data pipelines.
- Optimize ETL workflows and Snowflake queries for performance, scalability, and cost efficiency.
- Collaborate with business stakeholders, data architects, and engineering teams to understand requirements and deliver effective data solutions.
- Troubleshoot data pipeline failures, investigate data discrepancies, and resolve production issues.
- Use ServiceNow and JIRA for incident tracking, issue management, and project coordination.
- Maintain technical documentation and communicate project updates and technical findings effectively.
Required Technical Skills
- Snowflake: Data warehousing, SQL development, and data processing.
- DBT: Data transformation, model development, testing, and workflow management.
- AWS Glue: ETL development, data integration, and pipeline orchestration.
- AWS Lambda: Serverless computing, event-driven processing, and automation.
- ETL Development: End-to-end data pipeline design, implementation, and maintenance.
- SQL: Complex queries, data validation, transformation, and optimization.
- Communication: Strong written and verbal English communication skills.
- Ticketing Tools: Familiarity with ServiceNow and JIRA.
Required Qualifications
- 8–10+ years of relevant experience in ETL development, data engineering, or AWS data projects.
- Strong experience with AWS Glue and Lambda services.
- Hands-on expertise in DBT and Snowflake.
- Experience delivering end-to-end AWS development and data integration projects.
- Strong SQL skills and troubleshooting capabilities.
- Excellent communication and cross-functional collaboration skills.