Responsibilities

• Develop and maintain ETL pipelines using Databricks and Spark (Scala or PySpark)
• Work with Delta Lake, Lakehouse Federation, Unity Catalog, and Liquid Clustering
• Implement data migration and transformation workflows.
• Optimize performance and ensure data quality
• Collaborate across teams to deliver scalable data solutions
• Ensure compliance with data governance standards on Azure.

Requirements

• 5–8 years in data engineering
• Hands-on experience with Databricks, Spark, Hadoop, and Azure
• Familiarity with Lakehouse architecture and Delta Lake
• Strong problem-solving and analytical skills

Preferred

• Experience with advanced Databricks features (Unity Catalog, Liquid Clustering)
• Real-time data processing (Kafka, Event Hubs)
• CI/CD knowledge for data workflows

Posted By