Responsibilities

• Build and maintain data pipelines and Data Mesh architecture using Starburst and related technologies, integrating with cloud services and APIs.
• Monitor and optimize query performance, resolve bottlenecks, and ensure efficient data processing.
• Work with data scientists, analysts, and stakeholders to address data needs and ensure smooth onboarding of users to Starburst.
• Identify automation opportunities to improve efficiency and contribute to the development of new tools and processes.
• Ensure data integrity with best practices for testing and quality assurance. Maintain up-to-date documentation for processes and pipelines.
• Stay updated with industry trends and propose innovative solutions to enhance the data architecture.

Qualifications

• 6+ years of experience in data engineering with hands-on experience in Starburst Presto and Data Mesh.
• Strong SQL skills and experience with cloud platforms (AWS, GCP, Azure).
• Proven ability to optimize query performance and manage large-scale data environments.
• Excellent problem-solving, collaboration, and communication skills.
• Primary: Starburst Presto, Data Mesh, SQL, Cloud Services, APIs
• Expertise: Query Federation, Data Pipelines, Performance Optimization, Data Management

Posted By