Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

  • W2-Contract

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 6th Dec 2022

JOB DETAIL

SCALA, SPARK, SQL, HADOOP, AWS, HIVE, Spark SQL, HIVE QL, CICD (Continuous Integration/Continuous Delivery), VCS (GIT HUB)

 

·       Coding in Scala (60% of time)

·       Designing in of HADOOP ecosystem (20% of time)

·       Hands-on experience on AWS tools like EMR, EC2 (10% of time)

·       Hands-on experience of SQL in Big Data: SQL, Spark SQL, Hive QL (60% of time)

·       Proficient in working with large data sets and pipelines (20% of time)

·       Proficient with workflow scheduling / orchestration tools (20% of time)

·       Well versed with CICD process and VCS (20% of time)

·       In Scala, below hands-on experience is essential

o   Functional Programming and Object-Oriented Programming

o   Currying and Partially Applied Functions

o   Higher Order Functions

o   Tail Recursion

o   Futures

o   Case class

o   Pureconfig

o   Implicit Functions

o   Practical knowledge of all containers like list, map, array etc.

o   Implementation of foreach loop etc. for sorting instead of using direct function

 

Company Information