Data Engineer

Long Finch Technologies

Charlotte, NC

Posted On: Nov 08, 2024

Posted On: Nov 08, 2024

Job Overview

Job Type

Full-time

Experience

7 - 12 Years

Salary

$100,000 - $120,000 Per Year

Work Arrangement

On-Site

Travel Requirement

0%

Required Skills

  • Data Analysis
  • SQL
  • ETL
Job Description
Roles and Responsibilities
  • Design, build, and maintain scalable and high-performance data pipelines for processing large volumes of data.
  • Work with Hadoop ecosystem tools (HDFS, Hive, Pig, etc.) and PySpark to process and analyze large datasets efficiently.
  • Develop and optimize data models and ETL workflows for data warehousing solutions, ensuring high-quality, accurate, and accessible data for reporting and analytics.
  • Implement data job scheduling, automation, and monitoring using tools like Autosys.
  • Work closely with data scientists, analysts, and business stakeholders to understand data requirements and provide data-driven solutions.
  • Write complex SQL queries for data extraction, transformation, and loading (ETL), and use Python for data manipulation and automation tasks.
  • Troubleshoot performance issues in data processing systems and optimize existing workflows for efficiency and scalability.
  • Maintain clear and detailed documentation of data pipelines, processes, and system configurations.

 

Required Qualifications
  • 7+ years of professional experience as a Data Engineer, with a strong focus on Big Data technologies and data warehousing.
  • Expertise in Hadoop ecosystem (HDFS, Hive, Pig, etc.), and PySpark for distributed data processing.
  • Proficient in designing and building ETL workflows using various tools and technologies.
  • Proficiency in relational databases and SQL (e.g., Teradata, Oracle, PostgreSQL).
  • Strong Python programming skills for automating tasks and processing data.
  • Experience with job schedulers like Autosys for automating batch data processing workflows.

Job ID: LF240476


Posted By

Andy

HR Manager


Related Jobs
  • Contract - W2

  • Company
  • COMPANY

    Neshent Tech

  • Company
  • experience

    8 - 14 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    $60 - $70 Per Hour

  • Skills
  • SKILLS

    • AI Engineer
    • Data Engineer
    • Python

Posted On: Feb 10, 2025

  • Full-time

  • Company
  • COMPANY

    Long Finch Technologies

  • Company
  • experience

    6 - 12 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    $110,000 - $140,000 Per Year

  • Skills
  • SKILLS

    • Azure Data Factory
    • ETL
    • Azure Data Engineer
    • Microsoft Fabric

Posted On: Feb 10, 2025

  • Contract - W2
  • Contract - Corp-to-Corp
  • Contract - Independent

  • Company
  • COMPANY

    Neshent Tech

  • Company
  • experience

    8 - 15 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    Depends on Experience

  • Skills
  • SKILLS

    • Data Engineer
    • Consumer Data Platform
    • SaaS
    • DevOps

Posted On: Feb 05, 2025

  • Contract - W2

  • Company
  • COMPANY

    Techvilla Solutions

  • Company
  • experience

    3 - 8 Years

  • Travel Requirements
  • Work Arrangement

    Remote

  • Wallet
  • SALARY

    Depends on Experience

  • Skills
  • SKILLS

    • Data Analysis
    • BigQuery
    • Google Dataform
    • GitHub
    • +1 more

Posted On: Feb 04, 2025

  • Full-time

  • Company
  • COMPANY

    PB Consulting

  • Company
  • experience

    12 - 20 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    $120,000 - $150,000 Per Year

  • Skills
  • SKILLS

    • Snowflake
    • AWS
    • Data Engineer
    • Python
    • +1 more

Posted On: Feb 03, 2025