MS Data Fabric Lead Engineer

2T Consulting

Armonk, NY

Posted On: Sep 16, 2024

Posted On: Sep 16, 2024

Job Overview

Job Type

Contract - Independent, Contract - W2, Contract - Corp-to-Corp

Experience

10 - 16 Years

Salary

$70 - $75 Per Hour

Work Arrangement

Hybrid

Travel Requirement

0%

Required Skills

  • MS Data Fabric
  • ETL
  • Python/Pyspark
  • Azure data
  • SQL
Job Description
Roles and Responsibilities
  • Built multiple semantic models in Fabric leveraging Direct Lake query mode
  • Lead the design and implementation of Microsoft Fabric for data integration and analytics.
  • Architect and build scalable data and analytics platforms using Azure services.
  • Design and implement data models and data warehousing solutions to support complex analytical and reporting needs.
  • Develop and maintain ETL pipelines and data workflows.
  • Aggregate data from multiple sources and implement robust security measures for data environments.
  • Ensure data privacy and compliance with relevant regulations.
  • Employ source control tools and integration systems to enhance development workflows and team collaboration.

 

Required Experience/Skills
  • 10 years of data engineering experience
  • 5 years of experience in building data and analytics platform focused on Azure data and analytics solutions
  • 5 years of programming experience in Python/Pyspark
  • Must have experience in Microsoft Fabric and implemented at the least 2 major initiatives 
  • The ideal candidate should have a solid understanding of data modeling and data warehousing, with experience in cloud-based data migration and database management across various platforms
  • Should be skilled in aggregating data from multiple sources and implementing security measures for data environments
  • Familiarity with ETL tools and processes is essential, along with experience in using source control tools and integration systems to streamline development workflows.
  • Experience in Azure services such as:
    • Azure SQL Database
    • Azure Data Factory
    • Azure Synapse Analytics
    • Azure Data Lake

Job ID: 2C240386


Posted By

Shayne

Sr. Recruiter