Required Skills

Hadoop Hive Spark Mapreduce. REST API’s CI/CD

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 16th Dec 2020

JOB DETAIL

 

Job Title: Hadoop developer
Location: 
Duration: Longterm
Job Responsibilities:

The Data Engineer will be responsible to deliver business needs end to end from requirements to deployment into production.
Through a hands-on engineering approach, this individual will develop patterns, frameworks and applications which enable the building of a data pipeline.
The applicant will be responsible to follow software engineering best practices with an automation first approach and continuous improvement mindset.
The applicant will also drive reuse, engage in peer code reviews and foster innovation
The applicant will ensure adherence to enterprise architecture direction and architectural standards.
The applicant should be able to collaborate in a high-performing team environment, and an ability to influence and be influenced by others
Skills/qualifications:
At least 8 plus years of experience in software engineering developing data pipelines, API’s and integration technologies.
Experience with one or more of the following programming scripting languages – Python, JVM-based languages, or Javascript, and ability to pick up new languages.
Experience in stream data, such as Kafka.
Experience in Big Data technologies – Hadoop, Hive, Spark, Mapreduce.
Experience with Change Data Capture (CDC) and Extract, Transform and Load (ETL) tools.
Experience with building Data Pipelines that utilize Kafka or another pub/sub tool.
Experience with Cloud implementation, preferably AWS.
Experience with Master data Management (MDM) tools is a plus.
Experience with Snowflake & Databricks is a plus
Strong expertise with GIT.
Experience creating REST API’s.
Experience in building CI/CD pipelines.
Proficient in self-testing of applications, unit testing and use of mock frameworks, test-driven development (TDD).
Experience in building a software ‘product’ which will be transitioned to others for support and further evolution (including documentation, complete tooling/instrumentation, etc.).
General Qualifications
Ability to perform detailed analysis of business problems and technical environments.
Strong oral and written communication skills.
Strong teamwork and collaboration skills.
Ability to think strategically and implement iteratively. Ability to estimate financial impact of design/architecture alternatives

Company Information