- Handle day-to-day operations: Administer, and monitor big data platform components (Hadoop, Hive, HBase, BigSQL, etc)
- Support technical and application team requests- data copies across environments, data cleanup, query tuning, etc.
- Troubleshoot and resolve issues related to user queries, application jobs, etc.
- Monitor and troubleshoot big data platform, including hosted DBs, tools and services
- Creating encryption zones, managing encryption keys and copying data between the encryption zones
- Support projects/initiatives related to data acquisition, processing and utilization through big data platform
- Maintain and support big data platform (CDP Private cloud) and IBM BigSQL across multiple environments
- Install new versions, patches; support upgrades of CDP private cloud and IBM BigSQL
- Monitor and troubleshoot platform issues and performance tuning
- Support security policies, documentation and compliance
- Document processes and policies for Hadoop system administration & platform support activities
- Work with end users to identify and resolve issues
- Work with vendors to resolve issues as needed
- Provide governance and support to project teams
Academic/ Experience/ Competency
- Bachelors or master’s degree in computer science or applicable field of study
- 3-5 years of experience in Hadoop ecosystem (HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR)
- 6+ years of experience with JAVA and Linux/Unix
- 4+ years of experience with security, Scripting and Automation
- 2+ years of experience in R, Python, Flume, Storm, Kafka
- 2+ years of experience with IBM BigSQL or similar MPP SQL Engines
- 2+ years of experience with MYSQL
Experience with administration and performance tuning of Hadoop distributions (open source and commercial)
Highly competent with data lake concepts and big data capabilities
Good understanding of data virtualization and replication
Experience with AWS or other cloud-based PaaS/SaaS environments
Strong communication skills.