Technical / Functional Skills

• Extensive hands-on experience implementing Lake house architecture using Data bricks Data Engineering platform, SQL Analytics, Delta Lake, and Unity Catalog
• Extensive hands-on experience implementing enterprise grade Cloud Databricks Infrastructure(i.e., Azure Stack), RBAC, SCIM  etc., using IAC tools like Terraform
• Extensive hands-on experience implementing server less real-time/near real-time architecture using Cloud native services (i.e., Azure Stack), and Spark technologies (e.g., Spark Streaming, Spark ML)
• Experience in data governance fields as lineage, quality, catalog, multi-cloud experience, etc.
• 5+ years of experience in Data bricks engineering solutions on one of the Cloud platforms (Azure)
• 5+ years of experience in Data Architecture and delivery experience on one of the Cloud platforms (Azure)
• 5+ years of Demonstrated experience in Microsoft Azure cloud solutions, architecture, related technologies
• Demonstrable experience working in transformational projects where you implemented data platforms and/or ETL/ELT/CDC pipelines using Databricks
• 5+ years of Demonstrated experience in Microsoft Azure cloud solutions, architecture, related technologies
• Experience with conceptualizing and architecting data lakes on cloud-centric platforms; should be able to articulate the value and key components of data lakes
• Excellent interpersonal, verbal, and written communication skills
• Passionate about learning new technologies
• Bachelor’s degree or equivalent work experience

 
 

Responsibilities

• Implement Cloud(Azure) Delta lake house platform infrastructure, RBAC using IAC(Terraform) as per the industry best practices
• Work with architecture / security teams to remediate infrastructure related concerns and recommendations  
• Work with clients to define their cloud data platform and implement cutting-edge data solutions to provide valuable business insights including AI/ML
• Drive analysis, architecture, design, governance and development of data warehouse, data lake, and business intelligence solutions
• Research, synthesize, recommend, and select technical approaches for solving difficult migration, development, and integration problems
• Conduct and support workshops, design sessions, and project meetings as needed, playing a key role in client relations
• Utilize Lake house Fundamentals, Developer Foundations Capstone, Developer Essentials Capstone, etc.
• Collaborate applications teams/Business users to develop new pipe lines with Cloud data migration methodologies and processes including tools like Azure Data Factory, Event Hub, etc.
• On-call 24x7 support & Other duties as assigne