We are seeking an experienced Databricks DevOps Engineer to join our team. This role involves designing and developing automated pipelines, supporting cloud infrastructure, and ensuring the seamless deployment and integration of applications across various environments. The ideal candidate should have a strong background in Databricks, AWS, and containerization technologies and be adept at collaborating with cross-functional teams.
Roles and Responsibilities
- Design and build fully automated CI/CD pipelines for Databricks, UAC, AWS, Snowflake, Oracle, Teradata, Kubernetes, and Docker applications to support build, deployment, and testing across multiple environments.
- Automate the provisioning, deployment, and delivery of infrastructure in cloud environments.
- Provide ongoing support and troubleshoot deployment and environment issues in cloud-based systems.
- Develop processes for containerizing applications and managing containers within an artifact repository.
- Work closely with the Delivery and Cloud Platform teams for support and day-to-day activities.
- Plan, design, develop, modify, debug, and evaluate moderately complex software solutions.
- Analyze existing software and formulate logic for moderately complex new systems, understanding interface requirements.
- Create design documents for system integrations.
- Apply strong knowledge of relational databases, message queues, and batch processing systems.
Required Skills/Qualifications
- Hands-on experience with Databricks and AWS cloud services.
- Proficiency in automating infrastructure provisioning, deployment, and delivery.
- Expertise in containerization technologies (Docker, Kubernetes).
- Strong knowledge of CI/CD practices and implementation.
- Experience in developing and debugging software applications.
- Good understanding of system analysis and design for complex applications.
- Solid experience with relational databases, message queues, and batch systems.
- Bachelor’s degree in Computer Science, Engineering, or related field.
- Proven experience in DevOps, cloud infrastructure, and application development.