We are seeking an experienced AWS Engineer to design and implement comprehensive test strategies for our AWS-based ETL pipelines. The ideal candidate will be responsible for validating data extraction, transformation, and loading processes using a range of AWS services, including AWS Glue, Lambda, and Redshift. The role will also involve automating ETL testing and collaborating closely with cross-functional teams to ensure robust data validation and governance.

Responsibilities

• Design and implement test strategies for AWS-based ETL pipelines.
• Validate data extraction, transformation, and loading processes using AWS Glue, Lambda, and Amazon Redshift.
• Write and execute complex SQL queries for data validation and reconciliation.
• Automate ETL testing using scripting languages and frameworks like Python and Shell.
• Collaborate with data engineers, analysts, and business stakeholders to understand data requirements and create test scenarios.
• Identify, document, and track defects using tools like JIRA.
• Perform root cause analysis on data issues and collaborate with development teams for resolution.
• Ensure compliance with data governance, security, and quality standards.

Required Skills

• Strong SQL skills and experience with data warehousing concepts.
• Hands-on experience with AWS services such as Glue, Redshift, S3, Lambda, and Athena.
• Familiarity with CI/CD pipelines and version control systems like Git.
• Experience with test automation tools and frameworks.
• Knowledge of data migration/load testing from source to target.

Posted By