The Lead ETL Developer is responsible for designing, developing, testing, and implementing data solutions, including data warehouses, business intelligence solutions, and data migration projects. This role involves leading the Extract, Transform, and Load (ETL) development activities, ensuring the quality of ETL code, and providing mentorship to a team of developers. The Lead ETL Developer will collaborate with data architects, BI architects, and other stakeholders to design and develop scalable, robust data solutions for the healthcare industry. Additionally, this position requires leading the workflow of assigned staff, offering technical guidance, and identifying opportunities to optimize data environments.
Roles and Responsibilities
- Lead and oversee the design, development, and implementation of ETL processes for large-scale data integration projects.
- Mentor and guide a team of ETL developers, providing coaching and feedback to help them grow professionally.
- Collaborate with data architects, business intelligence architects, and other technical teams to design and implement scalable data solutions.
- Design and develop ETL workflows, data integration pipelines, and business intelligence solutions using IICS/IDMC, Amazon AWS, Snowflake, and other cloud-based tools.
- Ensure the quality, performance, and optimization of ETL code and database processes.
- Troubleshoot and resolve ETL-related issues, ensuring minimal downtime and efficient data processing.
- Strategize and lead the execution of roadmap projects, data modeling, ETL framework design, and the data mart life cycle.
- Ensure compliance with healthcare data security standards, privacy regulations (such as HIPAA), and best practices in data management.
- Automate ETL jobs using UNIX Shell scripting and Python.
- Create and maintain documentation, including ETL specifications, system designs, and process flows.
- Work closely with business stakeholders to understand data requirements and translate them into technical solutions.
- Act as a liaison between technical teams and business units to ensure alignment with organizational goals.
- Monitor and optimize the performance of ETL processes, databases, and data warehouses.
- Lead data migration projects and ensure data quality and consistency throughout the ETL process.
Qualifications
- At least 7+ years of experience in designing, developing, and testing ETL processes, preferably in the healthcare, analytical, or technology industries.
- At least 3 years of experience in an architect/lead role, guiding teams and managing technical projects.
- Experience with IICS (Informatica Intelligent Cloud Services)/IDMC is required.
- Strong background in data warehousing concepts, database design patterns, ETL methodologies, and data integration processes.
- Familiarity with Erwin data modeling toolset is a plus.
- Experience with UNIX Shell scripting and Python for automation of batch and ETL jobs.
- Familiarity with healthcare systems (e.g., QNXT, CCA, EDIFECS) is preferred.
- Strong understanding of data governance, data privacy, and compliance requirements, particularly in the healthcare sector.
- Proven expertise in developing cloud-based data platforms, including Amazon AWS, Snowflake, and other cloud technologies.
- Experience in leading and managing the development of large end-to-end Data Warehouse applications.
Skills and Abilities
- Strong technical leadership skills to guide teams in executing the EDM technology roadmap.
- Expertise in cloud-based ETL tools, particularly Informatica IDMC and Snowflake.
- Strong strategic thinking and problem-solving abilities to identify and implement effective IT strategies.
- Ability to communicate complex technical information clearly and concisely to both technical and business audiences.
- Strong interpersonal skills to build relationships with internal IT teams and business stakeholders.
- Excellent communication skills (written, verbal, and telephonic).
- Proven ability to manage multiple priorities and lead projects from concept to completion.