Lead Data Engineer

  • Salary

    $80 Per Hour

Experience

8 to 10 Years

Posted On

Dec 15, 2023

Company

2T Consulting

Travel Requirements

0%

Job Overview

Required Skills

  • Data Engineer
  • Python
  • TypeScript
  • GitHub
  • Terraform
  • CI/CD
  • Kafka
  • data warehouses/RDBMS
  • RESTful APIs

Job Type

Contract - Corp-to-Corp, Contract - Independent, Contract - W2

Work Authorization

N/A

Location

(Remote)

Job Description

Roles & Responsibilities:

  • Design, Mentor, and build reusable components, frameworks and libraries at scale to support data analytics, reports, and efficient database structures.
  • Design and implement product features in collaboration with business and Technology stakeholders.
  • Identify and solve issues concerning data management to improve data quality and efficiency.
  • Clean, prepare and optimize data for ingestion and consumption.
  • Collaborate on the implementation of new data management projects and re-structure of the current data architecture.
  • Review design, code, test plans and dataset implementation performed by other engineers in support of maintaining data engineering standards.
  • Analyze and profile data for designing scalable solutions.
  • Troubleshoot data issues and perform root cause analysis to proactively resolve product and operational issues.
  • Develop architecture, design patterns, and frameworks to process and store data and then align with varying downstream contracts for distribution.
  • Define and apply appropriate data acquisition and consumption strategies for given technical scenarios.
  • Implement security around sensitive data.
  • Create near real-time reporting in solutions like Tableau - automate data flows from DynamoDB to Athena into report visualization tools.

Experience/Qualification Required:

  • Bachelor/Master degree in Computer Science or related technical subject area or equivalent combination of education and experience
  • 10+ years relevant work experience in the Data Engineering field
  • 5+ years experience building scalable, real-time and high-performance cloud data lake solutions
  • Strong experience with data modeling and efficient design
  • Strong experience with programming languages such as Python and TypeScript.
  • Strong Experience with source control tools such as GitHub Actions, Terraform and related CI/CD processes
  • Experience working with Data streaming services such as Kafka, etc.
  • Strong Experience working with NoSQL data stores and caching mechanisms such as DynamoDB, DAX, etc.
  • Strong Experience provisioning RESTful APIs to enable real-time data consumption
  • Strong Experience working in AWS environment primarily S3, Lambdas, Redshift, Athena.
  • Strong experience with visual reporting and analytics tools like Tableau, and ETL tools such as Databricks.
  • Experience with data warehouses/RDBMS like Snowflake & Teradata
  • Strong collaborator with experience providing guidance and mentorship to other engineers
  • Strong understanding of algorithms, data structures, data architecture, and technical designs.
  • Proven track record of rapidly learning new technologies and developing and implementing proof of concepts and practical, working code
  • Proven track record to influence and communicate effectively with team members and business partners
  • Proven track record to partner with teams in solving complex problems by taking a broad perspective to identify innovative solutions. 
  • Experience working with Agile/Scrum methodology and tools like JIRA and Test Automation Frameworks
     

Job ID: 2C230293

  • Posted By

    Sheri F Weaver

Designation

Sr. Recruiter

Company

2T Consulting

Last Login

Mar 04, 2024

Posted On

Dec 15, 2023


Related Jobs
  • JobType
  • Contract - Corp-to-Corp

Posted On: Jan 04, 2024 11:59 AM


  • Company
  • COMPANY

    PB Consulting

  • Company
  • experience

    12 to 15 Years

  • Loction
  • work authorization

    N/A

  • Wallet
  • SALARY

    $80 Per Hour

  • Travel Requirements
  • Travel Requirements

    0%

  • Skills
  • SKILLS

    • Data Engineer
    • Scala
    • Databricks
    • SparkSQL / Spark Streaming / Python / Pyspark
  • JobType
  • Contract - Corp-to-Corp
  • Contract - Independent
  • Contract - W2

Posted On: Dec 15, 2023 11:20 AM


  • Company
  • COMPANY

    2T Consulting

  • Company
  • experience

    8 to 10 Years

  • Loction
  • work authorization

    N/A

  • Wallet
  • SALARY

    $80 Per Hour

  • Travel Requirements
  • Travel Requirements

    0%

  • Skills
  • SKILLS

    • Data Engineer
    • Python
    • TypeScript
    • GitHub
  • JobType
  • Full-time

Posted On: Aug 22, 2023 04:13 AM


  • Company
  • COMPANY

    2T Consulting

  • Company
  • experience

    7 to 12 Years

  • Loction
  • work authorization

    N/A

  • Wallet
  • SALARY

    $110,000 - $120,000 Per Year

  • Travel Requirements
  • Travel Requirements

    N/A

  • Skills
  • SKILLS

    • databases
    • ETL
    • Develop
    • Hadoop
  • JobType
  • Contract - Corp-to-Corp
  • Contract - W2

Posted On: Sep 02, 2022 12:00 AM


  • Company
  • COMPANY

    White Collar Technologies

  • Company
  • experience

    to Years

  • Loction
  • work authorization

    N/A

  • Wallet
  • SALARY

    N/A

  • Travel Requirements
  • Travel Requirements

    N/A

  • Skills
  • SKILLS

    • Lead Data Engineer (AWS)
  • JobType
  • Contract - Corp-to-Corp
  • Contract - Independent
  • Contract - W2

Posted On: Aug 26, 2022 12:00 AM


  • Company
  • COMPANY

    Longfinch

  • Company
  • experience

    10 to Years

  • Loction
  • work authorization

    N/A

  • Wallet
  • SALARY

    N/A

  • Travel Requirements
  • Travel Requirements

    N/A

  • Skills
  • SKILLS

    • Lead Data Engineer
    • SQL
    • Hadoop
    • Spark