• Us Citizen

• Green Card

• EAD (OPT/CPT/GC/H4)

• H1B Work Permit

• Corp-Corp

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 5th Jan 2021

Role : Big Data Engineer

Location : Columbus, IN

• Hands-On / Code – Primarily

• Lead and responsible for overall delivery and ownership

3.     Requirements gathering and clarification from SMEs.

4.       Performs code review and establishes code review process.

5.       Responsible for handling all customer specific technical queries

6.       Ensures adherence to customer standards, policies and quality compliance

7.       Ability to create data pipelines using Spark/ Event-Hub/ Streaming/ Azure Services using Parquet/ AVRA/ ORC/ Delta format.

8.       Develop pipeline objects using Apache Spark / Scala/ Python or PY Spark

9.       ADLS Gen1 to Gen2 Migration.

10.   HDI to Data bricks Migration.

Responsibilities:

1.       Working experience on pipeline implementation using Spark/ Event-Hub/ Streaming/ Azure Services

2.       Working experience on data format i.e. Parquet/ AVRA/ ORC/ Delta

3.       Working experience on IOT/ Machine Data/ Complex Data Format i.e. JSON/ XML/ Complex CSV Or Excel File/ Image File etc

4.       Working experience on Databricks environment

5.       Hands-on Experience using programming language – Scala, Python

6.       CICD using Jenkins

7.       Strong relational/non-relational database knowledge

8.       Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy

9.       Agile development and understanding

10.   Need to be aware of Maven/ Gradle/ SBT / ScalaTest

11.   Good to have JFrog knowledge

12.   Good to have Testing knowledge