Apache NiFi System Administrator

2T Consulting

Chesterfield, MO

Posted On: Oct 24, 2024

Posted On: Oct 24, 2024

Job Overview

Job Type

Contract - Corp-to-Corp, Contract - Independent, Contract - W2

Experience

5 - 15 Years

Salary

Depends on Experience

Work Arrangement

On-Site

Travel Requirement

0%

Required Skills

  • Apache NiFi
  • SFTP
  • data governance
  • Compliance
Job Description
Responsibilities
  • Design, implement, and manage data flows within Apache NiFi, ensuring efficient and reliable data movement across systems
  • Build scalable workflows for data ingestion, transformation, enrichment, and delivery
  • Configure processors, connections, and controllers to optimize data throughput and performance
  • Regularly monitor and maintain NiFi clusters, ensuring high availability and fault tolerance
  • Implement appropriate security measures, including user access control, data encryption, and SSL configurations within NiFi
  • Ensure compliance with organizational data governance policies and regulations
  • Work on integrating NiFi with other systems such as databases, cloud services (e.g., GCP, AWS, Azure) and other big data or messaging platforms
  • Implement monitoring tools and set up alerts to detect failures or performance issues
  • Generate reports on data flow metrics and performance for stakeholders
  • Optimize the performance of data transfer workflows by configuring NiFi's backpressure settings, load balancing, and ensuring high availability across NiFi clusters
  • Monitor file transfer and API performance, troubleshooting bottlenecks and optimizing workflows as needed for both throughput and latency
  • Ensure that the data transfer mechanisms built are scalable and sustainable for long-term use

 

Qualifications
  • 5+ years of experience in Apache NiFi for managing data flows, file transfers, and API integrations
  • Knowledge of secure file transfer protocols (SFTP, FTPS, HTTPS) and encryption methods
  • Experience integrating systems using APIs and working with open systems (cloud, on-premise, hybrid)
  • Strong understanding of data governance, compliance, and security practices, particularly in high-stakes M&A scenarios
  • Excellent troubleshooting and optimization skills for large-scale data migration and integration projects
  • Excellent communication skills both written and verbal.

Job ID: 2C240440


Posted By

Shayne

Sr. Recruiter