Data Engineer

2T Consulting

Charlotte, NC

Posted On: Apr 23, 2024

Job Overview

Job Type

Full-time

Experience

12 - 15 Years

Salary

Depends on Experience

Work Arrangement

On-Site

Travel Requirements

0%

Required Skills

  • Spark
  • Pyspark
  • T-SQL
  • PL/SQL
  • Shell Scripting
  • Python
  • Batch Script
  • PowerShell
  • Agile
  • Scrum
Job Description
Roles & Responsibilities
  • Development focused on client/server, web-based applications, and data warehouse design using logical/ physical data modeling, T-SQL, PL/SQL, SQL, SSIS, SSRS, PL/SQL, and performance tuning with some DBA activities such as backup, recovery, and troubleshooting, and maintenance.
  • Work on Spark Framework to ingest data from different source systems to SQL Server.
  • Provide support to team members helping them to understand the projects and requirements and guiding them to create the optimized solution for it
  • Team player with and proven track record of working in various team sizes and performing cross-functional roles.
  • Set up the CICD pipeline for database changes using Github, Jenkin & Liquibase).

 

Required Qualifications
  • 12+ Years of overall experience required.
  • Bachelor's degree in Computer Science, Information Technology, or related field
  • Extensive experience in database query tuning, performance tuning, PowerShell, Batch Script, and troubleshooting application issues on OLTP systems.
  • Strong experience in database migration such as MySQL to MS SQL Server and Oracle to MS SQL Server.
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
  • Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.

 

Primary Skills
  • Big Data: Spark, Scala, Pyspark, HDFS.
  • Microsoft Stack: T-SQL, DBA, SSIS, SSRS, PowerShell.
  • Oracle Database: PL/SQL, Shell Scripting, Exadata
  • Scripting Languages: Batch Script, Shell Script, Python, Kafka Streaming.
  • Agile, Scrum, Jira, Git, SVN, Liquibase.

Job ID: 2C240138


Posted By

Kanika Arora

Sr. Recruiter


Related Jobs
  • Contract - Corp-to-Corp
  • Contract - W2

  • Company
  • COMPANY

    Neshent Tech

  • Company
  • experience

    8 - 12 Years

  • Travel Requirements
  • Work Arrangement

    Hybrid

  • Wallet
  • SALARY

    $75 - $80 Per Hour

  • Skills
  • SKILLS

    • Azure
    • SQL
    • Azure Data Factory
    • Cloud
    • +1 more

Posted On: Jul 22, 2024


  • Company
  • COMPANY

    Neshent Tech

  • Company
  • experience

    5 - 7 Years

  • Travel Requirements
  • Work Arrangement

    Remote

  • Wallet
  • SALARY

    $70,000 - $90,000 Per Year

  • Skills
  • SKILLS

    • Snowflake
    • SQL
    • Scrum
    • Jira
    • +2 more

Posted On: Jul 16, 2024


  • Company
  • COMPANY

    Neshent Tech

  • Company
  • experience

    4 - 8 Years

  • Travel Requirements
  • Work Arrangement

    Remote

  • Wallet
  • SALARY

    $80,000 - $100,000 Per Year

  • Skills
  • SKILLS

    • Azure
    • Snowflake
    • CI/CD
    • SQL
    • +3 more

Posted On: Jul 08, 2024

  • Full-time

  • Company
  • COMPANY

    TechVilla Solutions

  • Company
  • experience

    8 - 10 Years

  • Travel Requirements
  • Work Arrangement

    On-Site

  • Wallet
  • SALARY

    $100,000 - $140,000 Per Year

  • Skills
  • SKILLS

    • GCP
    • AI/ML
    • SQL
    • Spanner
    • +1 more

Posted On: Jul 01, 2024

  • Full-time

  • Company
  • COMPANY

    2T Consulting

  • Company
  • experience

    10 - 12 Years

  • Travel Requirements
  • Work Arrangement

    Hybrid

  • Wallet
  • SALARY

    $120,000 - $150,000 Per Year

  • Skills
  • SKILLS

    • Python
    • Scala Spark
    • BigData
    • AWS S3
    • +3 more

Posted On: Jul 01, 2024