Required Skills

Kafka Nifi AWS Maven Stash Hadoop HBase Hive Pig and HBase

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 4th Feb 2021

JOB DETAIL

Job Description :                      

Client's business problem to solve?

Solution Architect to work with the client who is migrating from HDFS to EMR

 

Position's General Duties and Tasks

Qualifications

Worked as Lead Hadoop Developer

- Will be responsible for writing high-performance, reliable and maintainable code

- Will write MapReduce jobs

- Hadoop development, implementation and support

- Loading from disparate data sets

- Pre-processing using Hive and Pig

- Designing, building, installing, configuring and supporting Hadoop

- Translate complex functional and technical requirements into detailed design

- Perform analysis of vast data stores and uncover insights

- Maintain security and data privacy

- Create scalable and high-performance web services for data tracking

- High-speed querying

- Propose best practices/standards

 

Requirements:

 

10-12 years of Experience in Java/C++

Strong exposure in Object Oriented concepts and implementation

- 3+ years hands-on experience in Hadoop programming

- Hands on experience in Java, Scala and Spark

- Exposure to EMR would be an added bonus

- Good knowledge in back-end programming, specifically java, JS, Node.js and OOAD

- Writing high-performance, reliable and maintainable code.

- Ability to write MapReduce jobs.

- Good knowledge of database structures, theories, principles, and practices.

- Good understanding of Hadoop, YARN, MapR

- Familiarity with Kafka, Nifi, AWS, Maven, Stash and Bamboo

- Familiarity with data loading tools like Talend, Flume, Sqoop

- Familiarity of Apache Zeppelin

- Knowledge of workflow/schedulers like Oozie

- Analytical and problem solving skills, applied to Big Data domain

- Proven understanding with Hadoop, HBase, Hive, Pig, and HBase

- Good aptitude in multi-threading and concurrency concepts

Company Information