Big Data Developer

2T Consulting

Houston, TX

Posted On: Mar 26, 2024

Job Overview

Job Type

Full-time

Experience

3 - 6 Years

Salary

Depends on Experience

Work Arrangement

On-Site

Travel Requirements

0%

Required Skills

  • Big Data
  • Java
  • Scala
  • Python
  • RESTful
  • Spring-Boot
  • SQL
  • Kubernetes
Job Description

The Big Data Developer will be responsible for tasks such as data engineering, ETL (Extract Transform Load), data warehousing, and software development, collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.

Required Technical/Functional Skills
  • Advanced programming skills in Java/Scala/Python with a focus on Spark and Flink for large-scale data processing.
  • Strong understanding of the Cloudera suite, including in-depth knowledge of data management and processing services.
  • Proficient in building applications with Spring-Boot and Flask, with experience in creating RESTful services.
  • Experience with scripting and automation in a Linux environment, along with expertise in shell scripting.
  • In-depth knowledge of SQL, HQL, and the ability to perform query optimization on big data sets.
  • Proficient in Kubernetes, including deploying applications in OpenShift or other Kubernetes environments.
  • Familiarity with Neo4j or similar graph database technologies, and the ability to integrate them into big data solutions.
  • Experience with Cloudera Data Services such as Cloudera Data Engineering, Cloudera Data Warehouse, and Cloudera Machine Learning is highly desirable.
  • Experience in RAPIDS & GPU-Aware Scheduling.
  • Knowledge of data modeling, data access, and data storage techniques for big data.
Qualifications
  • Bachelor's degree in Computer Science, Engineering, or related field
  • Experience in data warehousing and software development
  • Strong problem-solving and analytical skills
  • Knowledge of database systems and SQL
  • Excellent communication and teamwork skills.
  • Minimum 4 years of Experience.

Job ID: 2C240096


Posted By

Kanika Arora

Sr. Recruiter


Related Jobs
  • Full-time

  • Company
  • COMPANY

    2T Consulting

  • Company
  • experience

    6 - 8 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    $80,000 - $100,000 Per Year

  • Skills
  • SKILLS

    • Linux
    • SQL
    • Kafka
    • Java
    • +2 more

Posted On: Jun 27, 2024

  • Full-time

  • Company
  • COMPANY

    Long Finch Technologies

  • Company
  • experience

    10 - 12 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    Depends on Experience

  • Skills
  • SKILLS

    • Big Data
    • Python
    • Java
    • Spark
    • +3 more

Posted On: Jun 10, 2024

  • Full-time

  • Company
  • COMPANY

    PB Consulting

  • Company
  • experience

    6 - 8 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    Depends on Experience

  • Skills
  • SKILLS

    • NoSQL
    • SQL
    • Java
    • Hadoop
    • +3 more

Posted On: Jun 05, 2024