Key Responsibilities

• Design and architect end-to-end data solutions leveraging Snowflake as the primary data warehouse.
• Build and optimise ETL/ELT pipelines using Matillion, ensuring scalability, performance, and reliability.
• Develop data models (conceptual, logical, and physical) addressing business and analytical requirements.
• Define and enforce data governance, data quality, and metadata management standards.
• Work closely with product, BI, analytics, and engineering teams to translate business needs into architectural blueprints.
• Optimise Snowflake performance: clustering, micro-partitioning, caching, warehouse sizing, and cost governance.
• Integrate data from various structured and unstructured sources.
• Review existing data systems and recommend modernisation opportunities.
• Ensure security best practices, including role-based access control, encryption, and compliance.
• Create documentation, architectural diagrams, and data flow maps.
• Drive best practices for CI/CD, data testing, and DevOps for data pipelines.

Required Skills 

• 10+ years of experience in data engineering or data architecture roles.
• Strong hands-on expertise in Matillion ETL/ELT (jobs, orchestration, components, transformations).
• Deep understanding of Snowflake—warehouses, schema design, streams, tasks, materialised views, performance tuning.
• Proficiency in SQL, data modelling, and data warehouse concepts (Kimball/Inmon).
• Experience with cloud platforms (AWS/Azure/GCP), especially AWS services like S3, Lambda, EC2, and IAM.
• Strong understanding of batch and real-time data processing patterns.
• Knowledge of data governance, master data management, and metadata frameworks.
• Experience with version control (Git) and CI/CD workflows.
• Ability to create architecture diagrams using tools like Lucidchart, Draw.io, or Visio.

Posted By