Tagcor

Hadoop

Install, configure, and maintain NiFi clusters (Hadoop/EC2, Kubernetes), ensuring high availability and fault tolerance – Must have.

Demonstrated experience with Helm, Kubernetes operators, Terraform – Must have.

Well versed in best practices for Kubernetes installation, Implementation and administration.

Collaborate with data engineers to optimize data pipelines, workflows, and data processing tasks.

Monitor system performance and capacity, conducting proactive tuning and scaling as needed.

Implement and enforce security protocols, access controls, and data governance policies in accordance with industry best practices.

Provide expert technical support, troubleshooting, and guidance to internal teams.

Develop and maintain comprehensive documentation, including architecture diagrams, configuration guidelines, and operational procedures.

Evaluate and recommend new technologies, tools, and best practices to enhance the existing infrastructure.

Coordinate with vendors and external support teams when necessary.

Assist with budgeting, planning, and reporting related to the NiFi environment (Hadoop/EC2, Kubernetes).

Education/Experience:

8+ years of hands-on experience as a Hadoop/NiFi Administrator or similar role in a large-scale environment.

Deep understanding of the Hadoop ecosystem components (HDFS) and Apache NiFi environment.

Proficiency in Linux/Unix systems, shell scripting, Java, and other programming languages.

Strong knowledge of networking, virtualization, cloud services (AWS), and containerization technologies (Docker, Kubernetes).

Strong communication skills, with the ability to convey complex technical concepts to non-technical stakeholders.

Relevant certifications in Kubernetes Admin, Hadoop, NiFi, or related technologies are a plus.

Proven track record of successfully implementing and managing complex projects