A Data Engineer with 7 to 12 years of experience is a highly skilled professional responsible for designing, building, and maintaining the data infrastructure that supports a company's data needs. They work with large and complex datasets to develop and implement data pipelines, data warehouses, and data lakes. Data Engineers also work closely with data scientists and other data professionals to ensure that the company's data is accessible, reliable, and secure.

Essential Duties and Responsibilities:

• Design, build, and maintain data pipelines to move data from source systems to data warehouses and data lakes
• Develop and implement data warehousing and data lake solutions
• Build and maintain data APIs
• Develop and implement ETL processes
• Integrate data from multiple sources
• Develop and implement data quality and governance policies
• Work with data scientists and other data professionals to support their data needs
• Troubleshoot and resolve data-related issues
• Stay up-to-date on the latest data engineering technologies and trends

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field
• 7 to 12 years of experience in data engineering
• Strong programming skills in Python, Java, Scala, or other programming languages
• Experience with big data technologies such as Hadoop, Hive, Spark, and Kafka
• Experience with data warehousing and data lake technologies such as AWS Redshift, Snowflake, and Google BigQuery
• Experience with data modeling and data warehouse design
• Experience with data quality and governance
• Experience with cloud computing platforms such as AWS, Azure, or Google Cloud Platform
• Strong problem-solving and analytical skills
• Ability to work independently and as part of a team
• Excellent communication and presentation skills

Posted By