Job Title: Data Engineer (Mid – Level)
Location: Mississauga, ON (ONSITE)
Mode of Hiring: Long Term Contract
Interview: 2 Rounds Interview (Video)
Overview:
We are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data modeling, SQL, ETL processes, and expertise working within Azure cloud environment, particularly with Databricks. You will play a pivotal role in designing, developing, and maintaining scalable data pipelines and supporting our data strategy initiatives.
Key Responsibilities:
- Design, develop, and optimize data models and schemas to support business needs.
- Develop, implement, and maintain efficient ETL pipelines using Spark, Databricks, and other tools.
- Write complex SQL queries, stored procedures, and functions to extract, transform, and load data from various sources.
- Collaborate with data analytics and business teams to understand data requirements and deliver solutions accordingly.
- Leverage Azure Data Services, including Azure Data Lake, Azure Data Factory, and Azure Databricks, to build scalable data solutions.
- Ensure data quality, governance, and security standards are maintained throughout all data processes.
- Monitor, optimize, and troubleshoot data pipelines to ensure high performance and availability.
- Document data architecture, workflows, and procedures, and participate in code reviews and best practice development.
Qualifications:
- 6 to 8 years of experience in data engineering, with strong expertise in data modelling and SQL.
- Must have experience in REST API, GraphQL.
- Proven experience with ETL development and data pipeline orchestration.
- Hands-on experience working with Azure cloud platform, specifically Azure Data Factory, Data Lake, and Databricks.
- Strong knowledge of Spark, Python, or Scala for data processing.
- Familiarity with data governance, security, and compliance best practices.
- Excellent problem-solving skills and attention to detail.
- Ability to work independently and as part of a collaborative team.
- Bachelor’s degree in Computer Science, Information Technology, or related field.
Preferred Qualifications:
- Certifications in Azure Data services or Databricks.
- Experience with BI tools and reporting.
- Knowledge of other cloud platforms is a plus.