Roles and Responsibilities

• Responsible for the administration, configuration, and optimization of the Databricks platform to enable data analytics, machine learning, and data engineering activities within the organization.
• Collaborate with data engineering team to ingest, transform, and orchestrate data.
• Manage privileges over the entire Databricks account, as well as at workspace level, Unity Catalog level and SQL warehouse level.
• Create workspaces, configure cloud resources, view usage data, and manage account identities, settings, and subscriptions.  
• Install, configure, and maintain Databricks clusters and workspaces. 
• Maintain Platform currency with security, compliance, and patching best practices.
• Monitor and manage cluster performance, resource utilization, platform costs, and troubleshoot issues to ensure optimal performance. 
• Implement and manage access controls and security policies to protect sensitive data.
• Administer interfaces with Azure AD and AWS.
• This position will involve participation in on- call rotation for 24/7 support.

Qualifications

• 4-yr College Degree preferably in Information Systems, Computer Science, Engineering, or related field.
• Knowledge about Apache Kafka is desirable
• 3+ years of production support of Databricks platform
• 2+ years AWS/Azure PaaS
• 2+ years of automation framework such as Terraform
• 2+ years of Hadoop administration (Cloudera/Hortonworks) preferred

Posted By