Senior Bigdata Developer / Lead

  • Salary

    $120,000 - $130,000 Per Year


8 to 12 Years

Posted On

Dec 16, 2022


2T Consulting

27 View

5 Applicants

Job Overview

Required Skills

  • Nifi
  • Hive
  • Airflow
  • Snowflake
  • Kafka
  • AWS
  • Lambda
  • Python
  • Big Data
  • spark
  • CI/CD

Job Type


Work Authorization



Bethesda, MD

Job Description

Technical / Functional Skills 

  • Involved in the Study of the business logic and coordinate with the client to gather the requirements.
  • Experience with Hive, Nifi, Airflow, Snowflake and Kafka
  • Experience in Cloud environments, particularly AWS - EC2, S3, Lambda 
  • Experience in Unit testing, integration testing for Spark scripts
  • Scripting with Bash, CSH, Shell, or Python
  • Designing and implementing large-scale ingest systems in a Big Data environment
  • Optimizing all stages of the data life cycle, from initial planning, to ingest, through final display and beyond
  • Designing and implementing data extraction, cleansing, transformation, loading, and replication/distribution capabilities
  • Developing custom solutions/code to ingest and exploit new and existing data sources
  • Working with Sponsor development teams to improve application performance
  • Providing support to maintain, optimize, troubleshoot, and configure the AWS/spark/Hadoop environment as needed
  • Collaborating with team-mates, other service providers, vendors, and users to develop new and more efficient method 
  • Experience with CI/CD pipelines, unit tests, integration, and regression testing
  • Significant experience with Airflow
  • Strong ability to manage competing priorities and communication to multiple stakeholders 
  • Bachelor's Degree in Computer Science, Computer Engineering, or a related discipline with experience in software design and development.

Job ID: 2C222382

  • Posted By

    Sheri F Weaver


Sr Recruiter


2T Consulting

Last Login

Jun 07, 2023

Posted On

Dec 16, 2022

Related Jobs