Required Skills

Big Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 14th Oct 2024

JOB DETAIL

1. Monitoring the above technologies / jobs via Nagios/ Incinga, using custom NRPE modules. Additionally, CM and other custom scripts leveraging Python & Bash are sometimes necessary (eg kafka consumer lag). 2. Creative troubleshooting and resolution for failures of any kind (hardware failures, job failures, services failures, health failures, missing data, etc). 3. Linux configuration management (via Puppet polices, when possible, hand curated for one-offs and snowflakes). 4. Data analysis. As data experts, we help diagnose and answer data related questions, leveraging datapoints within our clickstream data (eg: http headers, cookies, call-chaining, referrer, etc)5. Dev support. Both for our own developer and the many teams who have integrated with Hadoop/Kafka/Qlik. 6. As jobs are fixed/updated/enhanced, we QA and deploy them. 7. As performance issues are discovered, diagnose the root cause, tune and optimize. 8. handle patching, upgrading, migrating, etc for the entire ecosystem. 9. handle all Hadoop related Jira tickets. 10. Answer all questions and concerns as they come up via Teams or email.11. handle all security related issues: concerns, access, requests, auditing - both on-prem and in the cloud.12. participate in an on-call rotation.

Competencies: Digital : BigData and Hadoop Ecosystems, Digital : Cloudera Hadoop Administrator

Company Information