Key Responsibilities

• Design, develop, and maintain Master Data Management (MDM) solutions to ensure accurate, consistent, and reliable master data across the organization.
• Build and optimize scalable data pipelines and workflows using Databricks on the Azure cloud platform.
• Collaborate with data architects, business analysts, and data stewards to gather requirements and translate them into technical solutions.
• Develop and implement data integration processes, data quality rules, and data transformation logic within the Databricks environment.
• Create and maintain data models, metadata, and documentation for MDM processes.
• Apply best practices for data governance, security, and compliance within the MDM and Databricks ecosystem.
• Perform data profiling, analysis, and troubleshooting to resolve data issues and improve data quality.
• Automate routine tasks and implement continuous improvement initiatives.
• Mentoring junior team members and providing technical guidance on MDM and Databricks best practices.
• Stay updated with emerging trends and technologies in MDM, big data, and cloud-based data platforms.

Required Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or related field; Master’s preferred.
• Extensive experience in MDM design, development, and implementation.
• Proven expertise with the Databricks platform, including notebooks, Spark, Delta Lake, and Spark SQL.
• Strong programming skills in Python.
• Experience with cloud platforms such as Azure (Azure Data Factory, Azure Data Lake)
• Familiarity with data modeling, data warehousing, and ETL/ELT processes.
• Understanding of data governance, data quality, and master data concepts.
• Good knowledge of SQL and working with large datasets.
• Excellent problem-solving, communication, and team collaboration skills.

Preferred Qualifications

• Certifications in Databricks (e.g., Databricks Certified Data Engineer) or cloud platforms.
• Experience with other data integration tools and MDM solutions.
• Knowledge of data visualization and reporting tools.
• Prior experience in an Agile development environment.

Posted By