Bigdata Architect

  • Salary

    $150,000 - $180,000 Per Year

Experience

15 to 20 Years

Posted On

Oct 10, 2022

Company

PB Consulting

Travel Requirements

0%

Job Overview

Required Skills

  • Hive
  • Kafka
  • Snowflake
  • Spark
  • Scala
  • Java
  • Aws

Job Type

Full-time

Location

Bethesda, MD

Job Description

Responsibilities:

  • More than 10+ years of technical experience in data migration with design of Big Data systems
  • Experience in Data processing in Batch and Real time with design and implementation using Pyspark/Spark Scala.
  • Experience in event driven architecture design/solutioning using Kafka. 
  • Experience in Big Data technologies including SQL and NoSQL (HIVE, Hadoop, Couchbase DB, PostgreSQL) and Snowflake.
  • Experience working in large complex transformation or migration programs from initiation to implementation, preferable in travel & transportation hospitality domain 
  • Experience in Data ingestion from on premise, cloud, structured, semi-structured and unstructured data
  • Experience in modeling, design and mapping of data from different systems
  • Experience in ODS, Data warehouse, staging, data lake and data mart implementation
  • Experience in data architecture on AWS and Azure cloud (S3, SNS, SQS, Lambda, Azure data lake, SQL Data warehouse, DynamoDB)  
  • 10+ years of Bigdata technologies, handling large amounts of data, hundreds of Terabytes or more
  • Experience in legacy technologies Netteza, Oracle, DB2
  • Knowledge with data governance and best practices  
  • Propose and establish framework for necessary contributions from various development and program initiatives 
  • Bachelor's Degree in Computer Science, Computer Engineering, or a related discipline with experience in software design and development
  • Provide detailed specifications for proposed solutions
  • Advanced programming skills with Python, Java, Scala.
  • Advanced understanding of software development and collaboration, including experience with tools such as Git.
  • Excellent written and verbal communication skills, comfortable presenting in front of non-technical audiences. 
  • Experience is orchestration tools like Airflow, Jenkins
  • Experience in Apache Ni-Fi process

 

Preferred:

  • Excellent knowledge in hospitality domain in terms of migration
  • Cloud Solution Architect Certification, preferable AWS
  • Experience designing, architect Big Data solutions on cloud
  • Experience in large scale migration from legacy to cloud implementation
  • Experience with Spark streaming/batch, Kafka and Snowflake

Job ID: PBC00032

  • Posted By

    William Christopher

Designation

Sr. Manager

Company

PB consulting

Last Login

Apr 24, 2024

Posted On

Oct 10, 2022


Related Jobs