Roles and Responsibilities

• Design and build data pipelines to transform and load source data into data lakes, using big data platforms like Hadoop and Spark.
• Enhance and maintain data ingestion processes for healthcare applications, focusing on data validation, statistical reporting, and program validation.
• Develop and maintain data engineering processes using T-SQL, Spark, Scala, and shell scripting.
• Perform data analysis, troubleshooting, and root cause investigations using advanced data tools.
• Test and validate data accuracy prior to uploading to the data lake.
• Work collaboratively with Technical Operations to troubleshoot complex database issues, including OS, storage, and servers.
• Provide off-hours support to resolve production issues as needed.
• Mentor junior team members on data engineering practices and quality standards.
• Ensure business priorities are delivered within a Scaled Agile Framework (SAFe) environment.

Required Skills & Experience

• 5+ years of experience with data aggregation, standardization, linking, and reporting.
• 5+ years of experience with big data technologies such as Hadoop and Spark.
• Proficiency in RDBMS (Oracle, MS SQL Server) and SQL or other ETL tools.
• Solid understanding of Linux environments, shell scripting, and file systems.
• Strong experience in data troubleshooting and root cause analysis.
• Bachelor’s degree in Computer Science, Engineering, or a related field with 8-10 years of industry experience.
• Healthcare industry experience is preferred.

Posted By