Required Skills

Elasticsearch Logstash Kibana Apache Hadoop

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 12th Sep 2024

JOB DETAIL

  • Expert in setting up Hadoop cluster from scratch and server maintenance.
  • Commissioning and decommissioning of the nodes to/from Hadoop cluster.
  • Implementing, managing, and administering the overall Hadoop infrastructure.
  • Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
  • Monitoring the Hadoop cluster connectivity and performance of the cluster for application teams.
  • Replicating huge amount data from one Hadoop cluster to another.
  • Applying encryption to secure the data in the Hadoop cluster.
  • Applying the configuration changes and testing the cluster in collaboration with the application teams and business users.
  • Sound knowledge of Hadoop services - HDFS, Hive, HBase, Impala, Hue, Ranger etc.
  • Experience with Cloudera CDP Hadoop upgrade.
  • Experience with access management and setting up user roles in Hadoop.
  • Able to create and debug complex Unix shell scripts.

Nice to have:

  • Analyzing and troubleshooting the issues with the clusters.
  • Set up and maintain appropriate infrastructure to maintain performance and data integrity.
  • Experience with ELK Stack: Elasticsearch, Logstash, Kibana, Apache Hadoop
  • Ensuring appropriate monitoring & alerting of Elasticsearch cluster.
  • Expert in networking and security settings to support network related pipelines.
  • Good to have Ruby and/or Python, Unix and GIT Knowledge.

Company Information