Required Skills

Azure ADLSGEN2 Databricks -Delta Lake Azure Data factory PySpark Hadoop CLI Lambda Architecture Hadoop eco system Spark Linux Oracle/MySQL

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 21st Nov 2020

JOB DETAIL


Databricks certification Must
Big Data Engineer with expert level experience in   Azure  ADLSGEN2, Databricks -Delta Lake , Azure Data factory PySpark/Scala-Spark/Hive/Hadoop CLI/MapReduce/ Storm/Kafka/Nifi/Lambda Architecture
expert with using the larger Hadoop eco system
Familiar with job scheduling challenges in Hadoop
Experienced in creating and submitting Spark jobs
Experienced with Kafka and real-time analytics
Experience in high performance tuning and scalability
Core Java and Python/Spark background and their related libraries and frameworks
Experienced with Spring Framework and Spring Boot
Unix/Linux expertise; comfortable with Linux operating system and Shell Scripting
PL/SQL, RDBMS background with Oracle/MySQL
Familiarity with ORMs a plus
Design, Development, Unit and Integration testing of complex data pipelines and to handle data volumes to derive insights
Ability to optimize code to be able to run efficiently with stipulated SLA
Excellent problem-solving skills, with attention to detail, focus on quality and timely delivery of assigned tasks.

Regards:
Nathan.V
nathan.v@avanceservices.us

Company Information