Bigdata Architect

  • Salary

    $130,000 - $140,000 Per Year

Experience

10 to 15 Years

Posted On

Dec 16, 2022

Company

2T Consulting

Travel Requirements

0%

Job Overview

Required Skills

  • Big Data
  • Kafka
  • HIVE
  • NoSQL
  • Hadoop
  • Couchbase
  • PostgreSQL
  • Snowflake
  • Apache Ni-Fi
  • AWS

Job Type

Full-time

Location

Bethesda, MD

Job Description

Technical / Functional Skills 

  • More than 10+ years of technical experience in data migration with design of Big Data systems
  • Experience in Data processing in Batch and Real time with design and implementation using Pyspark/Spark Scala.
  • Experience in event driven architecture design/solutioning using Kafka. 
  • Experience in Big Data technologies including SQL and NoSQL (HIVE, Hadoop, Couchbase DB, PostgreSQL) and Snowflake.
  • Experience working in large complex transformation or migration programs from initiation to implementation, preferable in travel & transportation hospitality domain 
  • Experience in Data ingestion from on premise, cloud, structured, semi-structured and unstructured data
  • Experience in modeling, design and mapping of data from different systems
  • Experience in ODS, Data warehouse, staging, data lake and data mart implementation
  • Experience in data architecture on AWS and Azure cloud (S3, SNS, SQS, Lambda, Azure data lake, SQL Data warehouse, DynamoDB)  
  • 10+ years of Bigdata technologies, handling large amounts of data, hundreds of Terabytes or more
  • Experience in legacy technologies Netteza, Oracle, DB2
  • Knowledge with data governance and best practices  
  • Propose and establish framework for necessary contributions from various development and program initiatives 
  • Bachelor's Degree in Computer Science, Computer Engineering, or a related discipline with experience in software design and development
  • Provide detailed specifications for proposed solutions
  • Advanced programming skills with Python, Java, Scala.
  • Advanced understanding of software development and collaboration, including experience with tools such as Git.
  • Excellent written and verbal communication skills, comfortable presenting in front of non-technical audiences. 
  • Experience is orchestration tools like Airflow, Jenkins
  • Experience in Apache Ni-Fi process

 

Preferred:

  • Excellent knowledge in hospitality domain in terms of migration
  • Cloud Solution Architect Certification, preferable AWS
  • Experience designing, architect Big Data solutions on cloud
  • Experience in large scale migration from legacy to cloud implementation
  • Experience with Spark streaming/batch, Kafka and Snowflake

Job ID: 2C222381

  • Posted By

    Sheri F Weaver

Designation

Sr. Recruiter

Company

2T Consulting

Last Login

Apr 25, 2024

Posted On

Dec 16, 2022


Related Jobs