Roles & Responsibilities:

• Design, Mentor, and build reusable components, frameworks and libraries at scale to support data analytics, reports, and efficient database structures.
  
• Design and implement product features in collaboration with business and Technology stakeholders.
  
• Identify and solve issues concerning data management to improve data quality and efficiency.
  
• Clean, prepare and optimize data for ingestion and consumption.
  
• Collaborate on the implementation of new data management projects and re-structure of the current data architecture.
  
• Review design, code, test plans and dataset implementation performed by other engineers in support of maintaining data engineering standards.
  
• Analyze and profile data for designing scalable solutions.
  
• Troubleshoot data issues and perform root cause analysis to proactively resolve product and operational issues.
  
• Develop architecture, design patterns, and frameworks to process and store data and then align with varying downstream contracts for distribution.
  
• Define and apply appropriate data acquisition and consumption strategies for given technical scenarios.
  
• Implement security around sensitive data.
  
• Create near real-time reporting in solutions like Tableau - automate data flows from DynamoDB to Athena into report visualization tools.
  

Experience/Qualification Required:

• Bachelor/Master degree in Computer Science or related technical subject area or equivalent combination of education and experience
  
• 10+ years relevant work experience in the Data Engineering field
  
• 5+ years experience building scalable, real-time and high-performance cloud data lake solutions
  
• Strong experience with data modeling and efficient design
  
• Strong experience with programming languages such as Python and TypeScript.
  
• Strong Experience with source control tools such as GitHub Actions, Terraform and related CI/CD processes
  
• Experience working with Data streaming services such as Kafka, etc.
  
• Strong Experience working with NoSQL data stores and caching mechanisms such as DynamoDB, DAX, etc.
  
• Strong Experience provisioning RESTful APIs to enable real-time data consumption
  
• Strong Experience working in AWS environment primarily S3, Lambdas, Redshift, Athena.
  
• Strong experience with visual reporting and analytics tools like Tableau, and ETL tools such as Databricks.
  
• Experience with data warehouses/RDBMS like Snowflake & Teradata
  
• Strong collaborator with experience providing guidance and mentorship to other engineers
  
• Strong understanding of algorithms, data structures, data architecture, and technical designs.
  
• Proven track record of rapidly learning new technologies and developing and implementing proof of concepts and practical, working code
  
• Proven track record to influence and communicate effectively with team members and business partners
  
• Proven track record to partner with teams in solving complex problems by taking a broad perspective to identify innovative solutions. 
  
• Experience working with Agile/Scrum methodology and tools like JIRA and Test Automation Frameworks
   

Posted By