Data Engineering Infrastructure And Application Lead
Neshent Tech
Fremont, CA
Posted On: Feb 16, 2024
Posted On: Feb 16, 2024
Job Overview
Job Type
Contract - Corp-to-Corp
Experience
12 - 15 Years
Salary
$80 Per Hour
Work Arrangement
Remote
Travel Requirement
0%
Required Skills
CentOS / Redhat / Ubuntu
Azure
Infrastructure
Data Factory / Data Bricks
Big Data
Java / C++ / Python
MOAB / SLURM
IaaS / PaaS
Job Description
Job Description
Undergraduate/Ms degree in Computer Science or distributed systems
Experience with Linux based OS’s such as CentOS, Redhat, Ubuntu
Experience working as infrastructure lead in Azure ecosystem
Experience in working with Microsoft Azure services and application architecture and strong knowledge about Even Hub, ADLS, Blob Storage, Data Factory, Data Bricks, SQL WH etc
Must have strong experience in Big Data, ETL design and development, methodologies, tools, processes and best practices
5 years’ experience in Java/C++/Object Oriented systems programming and/or python, shell scripting (e.g. bash, PowerShell)
Experience building and deploying enterprise scale applications, familiarity with GPU computing
Understanding of Machine learning, simulation, and massive parallel compute architectures
Performance analysis and optimization, experience architecting and deploying highly reliable systems (HA, ACID, guaranteed delivery etc.)
Experience with scalable computer architectures (on premise and cloud (private cloud e.g. Openstack))
Experience with distributed computing/storage technologies like Hadoop (Map/Reduce, HDFS, HBase, in memory compute etc.), containerization such as docker
Understand requirements and goals for distributed computing.
Prior exposure to MOAB/SLURM and Cyclecloud strong plusses.
Experience with InfiniBand and clustered file systems
Design the appropriate computing and storage architecture to meet the customer goals
Hands-on engagement in the build out and delivery of the architecture
Experience operating in a Hybrid cloud environment and connectivity, prior exposure to Azure IaaS or equivalent required