Databricks Developer

  • Salary

    $110,000 - $120,000 Per Year

Experience

5 to 10 Years

Posted On

Apr 20, 2023

Company

Techvilla Solutions

Travel Requirements

N/A

Job Overview

Required Skills

  • Databricks Developer
  • Apache Spark
  • data engineers

Job Type

Full-time

Location

New York, NY

Job Description

We are seeking a highly skilled Databricks Developer to join our team and play a crucial role in the development and implementation of big data solutions. The ideal candidate will have extensive experience with Databricks, Apache Spark, and big data technologies. As a Databricks Developer, you will work closely with data engineers, data scientists, and other stakeholders to design, develop, and optimize scalable data processing pipelines. This is an excellent opportunity for someone with a passion for big data and a deep understanding of the Databricks ecosystem to make a significant impact on our organization.

Responsibilities:

  • Design, develop, and maintain scalable data processing pipelines using Databricks, Apache Spark, and other big data technologies.
  • Collaborate with data engineers, data scientists, and business teams to understand requirements and develop data solutions that meet their needs.
  • Optimize and fine-tune data processing pipelines for performance and scalability.
  • Implement data ingestion, transformation, and processing strategies to support data analytics and machine learning use cases.
  • Ensure data quality, integrity, and consistency throughout the data processing lifecycle.
  • Develop and maintain documentation for data processing pipelines, including data flow diagrams, technical specifications, and user guides.
  • Continuously stay up-to-date with the latest advancements in Databricks, Apache Spark, and big data technologies to drive innovation and improve data processing capabilities.
  • Participate in the full software development life cycle, from planning and analysis to deployment and support.

Requirements:

  • Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Minimum of 5 years of experience in big data development, with a focus on Databricks and Apache Spark.
  • Strong understanding of big data technologies, such as Hadoop, Hive, and Kafka.
  • Proficient in programming languages, such as Python, Scala, or Java.
  • Solid understanding of data structures, algorithms, and distributed computing principles.
  • Familiarity with cloud platforms, such as AWS, Azure, or Google Cloud Platform.
  • Excellent problem-solving skills, with the ability to effectively analyze and resolve complex technical issues.
  • Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.

Preferred Qualifications:

  • Knowledge of data warehousing concepts and technologies, such as Snowflake or Redshift.
  • Familiarity with data visualization tools, such as Tableau or Power BI.
  • Experience with machine learning frameworks, such as TensorFlow or PyTorch.
  • Understanding of Agile development methodologies and tools, such as Scrum or Kanban.

Job ID: TS230056

  • Posted By

    James William

Designation

Sr. HR

Company

Techvilla Solutions

Last Login

Mar 28, 2024

Posted On

Apr 20, 2023


Related Jobs
  • JobType
  • Full-time

  • Company
  • COMPANY

    Techvilla Solutions

  • Company
  • experience

    5 to 10 Years

  • Travel Requirements
  • Travel Requirements

    N/A

  • Wallet
  • SALARY

    $110,000 - $120,000 Per Year

  • Skills
  • SKILLS

    • Databricks
    • ETL
    • Databricks platform
    • AWS
  • JobType
  • Full-time

  • Company
  • COMPANY

    Neshent Tech

  • Company
  • experience

    10 to 15 Years

  • Travel Requirements
  • Travel Requirements

    0%

  • Wallet
  • SALARY

    $115,000 - $125,000 Per Year

  • Skills
  • SKILLS

    • Databricks
    • Spark
    • Spark SQL
    • Python
  • JobType
  • Full-time

  • Company
  • COMPANY

    Techvilla Solutions

  • Company
  • experience

    5 to 10 Years

  • Travel Requirements
  • Travel Requirements

    N/A

  • Wallet
  • SALARY

    $110,000 - $120,000 Per Year

  • Skills
  • SKILLS

    • Databricks Developer
    • Apache Spark
    • data engineers
  • JobType
  • Full-time

  • Company
  • COMPANY

    Neshent Tech

  • Company
  • experience

    6 to 10 Years

  • Travel Requirements
  • Travel Requirements

    0%

  • Wallet
  • SALARY

    $105,000 - $115,000 Per Year

  • Skills
  • SKILLS

    • Databricks
    • Spark
    • Python
    • SQL
  • JobType
  • Full-time

  • Company
  • COMPANY

    Neshent Technologies

  • Company
  • experience

    8 to 10 Years

  • Travel Requirements
  • Travel Requirements

    0%

  • Wallet
  • SALARY

    $120,000 - $130,000 Per Year

  • Skills
  • SKILLS

    • Databricks
    • Cloud
    • Spark
    • Scala