Data Engineering Infrastructure And Application Lead

Neshent Tech

Fremont, CA

Posted On: Feb 16, 2024

Posted On: Feb 16, 2024

Job Overview

Job Type

Contract - Corp-to-Corp

Experience

12 - 15 Years

Salary

$80 Per Hour

Work Arrangement

Remote

Travel Requirement

0%

Required Skills

  • CentOS / Redhat / Ubuntu
  • Azure
  • Infrastructure
  • Data Factory / Data Bricks
  • Big Data
  • Java / C++ / Python
  • MOAB / SLURM
  • IaaS / PaaS
Job Description

Job Description

  • Undergraduate/Ms degree in Computer Science or distributed systems
  • Experience with Linux based OS’s such as CentOS, Redhat, Ubuntu
  • Experience working as infrastructure lead in Azure ecosystem
  • Experience in working with Microsoft Azure services and application architecture and strong knowledge about Even Hub, ADLS, Blob Storage, Data Factory, Data Bricks, SQL WH etc
  • Must have strong experience in Big Data, ETL design and development, methodologies, tools, processes and best practices
  • 5 years’ experience in Java/C++/Object Oriented systems programming and/or python, shell scripting (e.g. bash, PowerShell)
  • Experience building and deploying enterprise scale applications, familiarity with GPU computing
  • Understanding of Machine learning, simulation, and massive parallel compute architectures
  • Performance analysis and optimization, experience architecting and deploying highly reliable systems (HA, ACID, guaranteed delivery etc.)
  • Experience with scalable computer architectures (on premise and cloud (private cloud e.g. Openstack))
  • Experience with distributed computing/storage technologies like Hadoop (Map/Reduce, HDFS, HBase, in memory compute etc.), containerization such as docker
  • Understand requirements and goals for distributed computing.
  • Prior exposure to MOAB/SLURM and Cyclecloud strong plusses.
  • Experience with InfiniBand and clustered file systems
  • Design the appropriate computing and storage architecture to meet the customer goals
  • Hands-on engagement in the build out and delivery of the architecture
  • Experience operating in a Hybrid cloud environment and connectivity, prior exposure to Azure IaaS or equivalent required

Job ID: NT240051


Posted By

Abhishek

HR Manager