Experience Required

• 8+ years of experience in big data technologies Hadoop, Hive, Yarn, Pig , Kafka, Spark.
• Hands on experience tuning Spark and Hive workloads for performance.
• Hands on scripting skills in python or bash.
• Good knowledge on Azure stack (Storage, Compute, Network) and tools like ADF, Power BI, Azure Monitor, Log Analytics.
• Good knowledge of Linux OS fundamentals.
• Experience on HDInsight is a plus 

 

Roles & Responsibilities

• Run prototype with customer to migrate Big-data workloads into Azure HDInsight.
• Performance tuning for Spark, Hive and Hadoop jobs.
• Troubleshoot production issues, identify the root-cause, and provide mitigation.
• Build tools and services to improve the debuggability/supportability.
• Monitoring cluster health for top customers and provide support.