Big Data Developer

  • Salary

    $80,000 - $120,000 Per Year

Experience

3 to 6 Years

Posted On

Mar 26, 2024

Company

2T Consulting

Travel Requirements

0%

Job Overview

Required Skills

  • Big Data
  • Java
  • Scala
  • Python
  • RESTful
  • Spring-Boot
  • SQL
  • Kubernetes

Job Type

Full-time

Location

Houston, TX

Job Description

The Big Data Developer will be responsible for tasks such as data engineering, ETL (Extract Transform Load), data warehousing, and software development, collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.

Required Technical/Functional Skills
  • Advanced programming skills in Java/Scala/Python with a focus on Spark and Flink for large-scale data processing.
  • Strong understanding of the Cloudera suite, including in-depth knowledge of data management and processing services.
  • Proficient in building applications with Spring-Boot and Flask, with experience in creating RESTful services.
  • Experience with scripting and automation in a Linux environment, along with expertise in shell scripting.
  • In-depth knowledge of SQL, HQL, and the ability to perform query optimization on big data sets.
  • Proficient in Kubernetes, including deploying applications in OpenShift or other Kubernetes environments.
  • Familiarity with Neo4j or similar graph database technologies, and the ability to integrate them into big data solutions.
  • Experience with Cloudera Data Services such as Cloudera Data Engineering, Cloudera Data Warehouse, and Cloudera Machine Learning is highly desirable.
  • Experience in RAPIDS & GPU-Aware Scheduling.
  • Knowledge of data modeling, data access, and data storage techniques for big data.
Qualifications
  • Bachelor's degree in Computer Science, Engineering, or related field
  • Experience in data warehousing and software development
  • Strong problem-solving and analytical skills
  • Knowledge of database systems and SQL
  • Excellent communication and teamwork skills.
  • Minimum 4 years of Experience.

Job ID: 2C240096

  • Posted By

    Sheri F Weaver

Designation

Sr. Recruiter

Company

2T Consulting

Last Login

May 02, 2024

Posted On

Mar 26, 2024


Related Jobs