Databricks ETL Developer

We are looking for a Databricks ETL Developer with 3–5 years of hands-on experience in SQL development within data warehouse and ETL environments. The ideal candidate will have strong expertise in analyzing and transforming complex legacy SQL, along with practical experience working with Databricks and Spark SQL.

The role requires someone who can work independently from established templates and technical requirements while delivering high-quality ETL solutions in a fast-paced environment.

Roles and Responsibilities

• Develop, modify, and maintain ETL processes and data transformation workflows using SQL and Databricks.

• Analyze, interpret, troubleshoot, and rewrite complex legacy SQL to meet current business and technical requirements.

• Develop and execute data transformation logic using Databricks and Spark SQL.

• Work with YAML-driven and template-based ETL frameworks to implement data pipelines and transformation workflows.

• Translate defined requirements and existing ETL templates into accurate and maintainable solutions.

• Review existing SQL and ETL logic to identify opportunities for correction, modernization, and optimization.

• Perform data validation and troubleshooting to ensure accuracy, completeness, and consistency of ETL outputs.

• Work independently while following established development standards, templates, and requirements.

• Collaborate with technical and business teams to clarify requirements and resolve data-related issues.

• Deliver ETL development tasks within a fast-paced delivery environment and meet project timelines.

Required Skills & Experience

• 3–5 years of hands-on SQL development experience in data warehouse, ETL, or data engineering environments.

• Strong proficiency in SQL, including complex queries, joins, subqueries, CTEs, transformations, and data manipulation.

• Demonstrated ability to read, understand, troubleshoot, and rewrite complex legacy SQL.

• Hands-on experience with Databricks.

• Working knowledge of Spark SQL and data transformation concepts.

• Familiarity with YAML-driven, metadata-driven, or template-based ETL frameworks.

• Ability to work independently using defined templates, technical requirements, and development standards.

• Strong analytical and problem-solving skills.

• Comfortable working in a fast-moving delivery environment with multiple priorities and deadlines.

• Good understanding of ETL and data warehouse concepts.

Posted By