Strong experience in Deploying a Hadoop cluster, maintaining a hadoop cluster, adding and removing nodes using cluster monitoring tools like Cloudera Manager, configuring high availability and keeping a track of all the running hadoop jobs.
A hadoop administrator will have to work closely with the database team, network team and application teams to make sure that all the big data applications are highly available and performing as expected.
Monitoring the cluster connectivity and performance.
Manage and review Hadoop log files.
Create and maintain documentation for platform configurations, changes, and issues.
Provide support for engineering team on HDP and CDP cluster related issues.
Maintain security and compliance standards across the platform.
Backup and recovery tasks
Requirements:
Minimum of 3 years of experience with Cloudera Hadoop Admin( CDP ) install/migration and Active directory integration experience and replication experience.
Strong experience and understanding of Hadoop kerborized clusters ( with Active Directory ), HA setup and performance tuning .
Strong experience on Replication using Cloudera manager and troubleshooting of CDP cluster issues.
Strong analytical and troubleshooting skills.
Excellent communication and collaboration skills
Good to have knowledge of Oracle DB and scripting/automation tools such as Python, Shell, or Ansible for cluster setup, backup, data copy, and monitoring.