Technical / Functional Skills
- More than 10+ years of technical experience in data migration with design of Big Data systems
- Experience in Data processing in Batch and Real time with design and implementation using Pyspark/Spark Scala.
- Experience in event driven architecture design/solutioning using Kafka.
- Experience in Big Data technologies including SQL and NoSQL (HIVE, Hadoop, Couchbase DB, PostgreSQL) and Snowflake.
- Experience working in large complex transformation or migration programs from initiation to implementation, preferable in travel & transportation hospitality domain
- Experience in Data ingestion from on premise, cloud, structured, semi-structured and unstructured data
- Experience in modeling, design and mapping of data from different systems
- Experience in ODS, Data warehouse, staging, data lake and data mart implementation
- Experience in data architecture on AWS and Azure cloud (S3, SNS, SQS, Lambda, Azure data lake, SQL Data warehouse, DynamoDB)
- 10+ years of Bigdata technologies, handling large amounts of data, hundreds of Terabytes or more
- Experience in legacy technologies Netteza, Oracle, DB2
- Knowledge with data governance and best practices
- Propose and establish framework for necessary contributions from various development and program initiatives
- Bachelor's Degree in Computer Science, Computer Engineering, or a related discipline with experience in software design and development
- Provide detailed specifications for proposed solutions
- Advanced programming skills with Python, Java, Scala.
- Advanced understanding of software development and collaboration, including experience with tools such as Git.
- Excellent written and verbal communication skills, comfortable presenting in front of non-technical audiences.
- Experience is orchestration tools like Airflow, Jenkins
- Experience in Apache Ni-Fi process
Preferred:
- Excellent knowledge in hospitality domain in terms of migration
- Cloud Solution Architect Certification, preferable AWS
- Experience designing, architect Big Data solutions on cloud
- Experience in large scale migration from legacy to cloud implementation
- Experience with Spark streaming/batch, Kafka and Snowflake