Data Engineer With ML, Java, Spark, Scala

2T Consulting

Sunnyvale, CA

Posted On: Mar 18, 2024

Posted On: Mar 18, 2024

Job Overview

Job Type

Full-time

Experience

10 - 12 Years

Salary

$130,000 - $140,000 Per Year

Work Arrangement

On-Site

Travel Requirement

0%

Required Skills

  • Data Engineering
  • Big Data
  • Java
  • Scala
  • Spark
  • PySpark
  • Golang
  • Hadoop
  • Cloud-native
  • LLM
  • ETL
Job Description

Job Description

  • Build data pipelines to enable training of LLMs
  • Work with technical and non-technical stakeholders to collect requirements, integrate with data systems and deliver large-scale datasets 
  • Operate in a complex multi-cloud data lakehouse, building end-to-end integrated workflows
  • Work with privacy, security, and other policy stakeholders to design, review and implement solutions to automate compliant ETL for downstream teams

 

Qualifications

  • Strong understanding of machine learning principles, especially in the context of LLMs. 
  • 5+ years of experience in big data engineering
  • Proficiency in Java, Scala, Spark
  • Proficiency in PySpark and Golang (preferred)
  • Experience building and leveraging large scale data infrastructure, map-reduce/hadoop, cloud-native deployments
  • Experience with alerting, monitoring and remediation automation in a large scale distributed environment 
  • BS/BA or equivalent degree in computer science or similar (preferred)

Job ID: 2C240082


Posted By

Shayne

Sr. Recruiter


Related Jobs
  • Full-time

  • Company
  • COMPANY

    Long Finch Technology LLC

  • Company
  • experience

    8 - 20 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    Depends on Experience

  • Skills
  • SKILLS

    • Java
    • J2EE
    • Spring
    • Spring/Springboot
    • +4 more

Posted On: Nov 14, 2025

  • Full-time

  • Company
  • COMPANY

    PB Consulting

  • Company
  • experience

    7 - 12 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    Depends on Experience

  • Skills
  • SKILLS

    • Shell Scripting
    • Linux
    • Glassbox
    • Systems Engineer
    • +1 more

Posted On: Nov 14, 2025

  • Contract - Corp-to-Corp

  • Company
  • COMPANY

    Long Finch Technologies

  • Company
  • experience

    8 - 25 Years

  • Travel Requirements
  • Work Arrangement

    Hybrid

  • Wallet
  • SALARY

    Depends on Experience

  • Skills
  • SKILLS

    • Python
    • api
    • Java
    • docker
    • +1 more

Posted On: Nov 14, 2025

  • Contract - W2
  • Contract - Independent

  • Company
  • COMPANY

    2T Consulting

  • Company
  • experience

    8 - 12 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    Depends on Experience

  • Skills
  • SKILLS

    • Java
    • React
    • Node.js
    • Node.js
    • +4 more

Posted On: Nov 12, 2025

  • Full-time

  • Company
  • COMPANY

    Techvilla Solutions

  • Company
  • experience

    10 - 15 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    Depends on Experience

  • Skills
  • SKILLS

    • React Native
    • Mobile Application
    • Redux
    • Axios
    • +2 more

Posted On: Nov 11, 2025