• Propose good and optimized solutions and architecture for new/existing projects 
• Solutions should primarily focus on saving latency and costs in batch and streaming environment 
• Create cost reports for existing sources in databricks.
• Monitor current Azure/Databricks resources + Cost used and suggest best resources/configurations for new/existing projects
• Work on databricks core projects (this can be moving sources to databricks/configuration changes etc.) 
• Collect requirements from customer and lead the offshore team to deliver the projects assigned.

Required Skills

• Azure databricks (Core), Azure Admin and platform services, Cosmos DB, Pyspark, Python, SQL, SSIS, ETL
• Azure cost and storage management
• Streaming and batch data processing in Hadoop and Cloud Databricks environment