Explore data, identify the right sources; perform data extraction and transformation Perform data validation.
Implement and provide support for data pipelines and reports.
Implement monitoring of all critical data pipelines.
Support migration to Azure Lens Orchestrator from Xflow Self Service/Datawarehouse Support ADF /lens pipelines to ingress into Synapse on a regular basis (performance, reprocessing, and monitoring).
Support visualization/reporting on top of data via Cube, PowerBI premium (based on cost/size needs), excel or Spark Rhythm of Business
Maintenance and Sustenance of existing Data Pipelines.
Workflow Monitoring and Fixes.
Required Qualifications
Bachelor's degree in Computer Science, Information Technology, or related field.
Experience with Azure data storage solutions such as Azure SQL Database, Azure Cosmos DB, and Azure Data Lake Storage.
Knowledge of data integration tools such as Azure Data Factory and Azure Databricks
Understanding of data modeling and schema design principles.
Ability to work with large datasets and perform data analysis.