Required Skills

Big Data Developer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 5th Feb 2024

JOB DETAIL

  • Expert in setting up Elasticsearch cluster from scratch and server maintenance.
  • Expert in setting up Hadoop cluster from scratch and server maintenance.
  • 7+ years of experience with ELK Stack and Hadoop: Elasticsearch, Logstash, Kibana, Apache Hadoop
  • Able to create and debug complex Unix shell scripts.
  • Decommissioning and Recommissioning servers.
  • Analyzing and troubleshooting the issues with the clusters.
  • Evaluate existing Elastic clusters, configuration parameters, indexing, security, and administration.
  • Set up and maintain appropriate infrastructure to maintain performance and data integrity.
  • Elasticsearch upgrade experience and following best practices.
  • Ensuring appropriate monitoring & alerting of Elasticsearch cluster.
  • Expert in networking and security settings to support network related pipelines.
  • Good to have Ruby andor Python, Unix and GIT Knowledge.
  • Deploying and maintaining a Hadoop cluster
  • Commissioning and decommissioning of the nodes tofrom the Hadoop cluster.
  • Implementing, managing, and administering the overall Hadoop infrastructure
  • Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
  • Monitoring the Hadoop cluster connectivity and performance of the cluster for application teams.
  • Replicating huge amount data from one Hadoop cluster to another.
  • Applying encryption to secure the data in the Hadoop cluster.
  • Applying the configuration changes and testing the cluster.
  • Sound knowledge of Hadoop services HDFS, Hive, HBase , Impala , Hue , Ranger etc.
  • Experience with Cloudera CDP Hadoop upgrade will be good to have.

Company Information