The Databricks Admin will be responsible for managing, configuring, and maintaining Databricks platforms to ensure optimal performance, security, and functionality. The role will involve collaborating with data engineering teams, troubleshooting issues, and implementing best practices for cloud data management and analytics.
Key Responsibilities
- Administer and configure Databricks environments (workspaces, clusters, jobs, and libraries).
- Manage user access, roles, and permissions within Databricks.
- Monitor system performance and resolve any operational issues.
- Implement best practices for data processing and security within Databricks.
- Work with data engineers and analysts to optimize ETL pipelines and workflows.
- Ensure the integration of Databricks with other cloud services (AWS, Azure, GCP).
- Perform troubleshooting, issue resolution, and root cause analysis for Databricks-related problems.
- Keep up to date with new features and functionalities of the Databricks platform.
Qualifications
- Strong experience with Databricks administration in cloud environments.
- Hands-on experience with Spark, Python, and Databricks notebooks.
- Familiarity with cloud platforms like AWS, Azure, or GCP.
- Experience in managing user roles and permissions in Databricks.
- Strong understanding of data security and governance practices.
- Excellent troubleshooting and problem-solving skills.