Sr. Data Engineer

2T Consulting

Philadelphia, PA

Posted On: Jul 02, 2024

Posted On: Jul 02, 2024

Job Overview

Job Type

Full-time

Experience

10 - 12 Years

Salary

$120,000 - $150,000 Per Year

Work Arrangement

Hybrid

Travel Requirement

0%

Required Skills

  • Python
  • Scala Spark
  • BigData
  • AWS S3
  • Databricks
  • Hadoop
  • APIs
Job Description
Duties and Responsibilities
  • Identify, analyze, and interpret trends or patterns in complex data sets.
  • Develop and implement databases, data collection systems, data analytics, and other strategies that optimize statistical efficiency and quality.
  • Acquire data from primary or secondary data sources and maintain databases/data systems.
  • Interpret data, analyze results using statistical techniques, and provide ongoing reports.
  • Filter and clean data by reviewing reports and performance indicators to locate and correct problems.
  • Work with management to prioritize business and information needs.

 

Qualifications/Skills
  • Hands-on architecture/development of ETL pipelines using our internal framework written in Java.
  • Hands-on architecture of real-time REST APIs or other solutions for streaming data from Graph using Spark.
  • Experienced with Databricks.
  • Advanced knowledge of Python and Linux shell scripting.
  • Experience working with cloud infrastructure services like Amazon Web Services.

Job ID: 2C240273


Posted By

Shayne

Sr. Recruiter


Related Jobs
  • Full-time

  • Company
  • COMPANY

    2T Consulting

  • Company
  • experience

    10 - 12 Years

  • Travel Requirements
  • Work Arrangement

    Hybrid

  • Wallet
  • SALARY

    $120,000 - $150,000 Per Year

  • Skills
  • SKILLS

    • Python
    • Scala Spark
    • BigData
    • AWS S3
    • +3 more

Posted On: Jul 02, 2024