Required Skills

MapReduce Hive Pig Spark Kafka HBase HDFS H-catalog Zookeeper

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 16th Aug 2024

JOB DETAIL

·Responsible for implementation and ongoing administration of Hadoop Infrastructure.

·Responsible for Cluster maintenance, troubleshooting, monitoring, and backup & recovery strategies.

·Provisioning and managing the life cycle of multiple clusters like EMR & EKS.

·Infrastructure monitoring, logging & alerting with Prometheus/Grafana/Splunk.

·Performance tuning of Hadoop clusters and Hadoop workloads and capacity planning at application/queue level.

·Responsible for memory management, queue allocation, distribution experience in Hadoop/Cloud environments.

·Monitor Hadoop cluster connectivity and security, file system (HDFS) management and monitoring.

·Investigates and analyzes new technical possibilities, tools, and techniques that reduce complexity and create better technical solutions.

·Involved in fixing issues, RCA, suggesting solutions for infrastructure/service components.

·Responsible for meeting Service Level Agreement (SLA) targets and ensuring team targets are met.

·Ensure all changes to the production systems are planned and approved in accordance with the Change Management process.

·Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.

·Maintain central dashboards for all system, data, utilization, and availability metrics.

What an Ideal Candidate Will Look Like:

·8-12 years of total experience with at least 5 years of work experience in developing, maintaining, optimization, issue resolution of Hadoop clusters, supporting business users.

·Experience in Linux/Unix OS services, administration, shell, awk scripting.

·Strong knowledge of any one programming language (Python/Scala/Java/R) with debugging skills.

·Experience in Hadoop (MapReduce, Hive, Pig, Spark, Kafka, HBase, HDFS, H-catalog, Zookeeper, and Oozie/Airflow).

·Experience in Hadoop security (Kerberos, Knox, TLS).

·Hands-on experience in SQL and NoSQL databases (HBASE) with performance optimization.

·Experience in tool integration, automation, configuration management in GIT, Jira platforms.

·Excellent oral and written communication and presentation skills, analytical and problem-solving skills.

Company Information