Required Skills

Data Engineer AWS platform Snowflake Apache Spark EMR Hadoop Kafka KStream AVRO JSON

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 14th Jan 2021

JOB DETAIL

.        Experienced Sr. Data Engineer with hands on expertise on the following technologies.

•             Big Data : Batch & stream data processing using AWS platform, Snowflake, Apache Spark, EMR, Hadoop, Kafka, KStream, Data as a service (API)

•             Hadoop file format : AVRO, JSON, Parquet

•             Datawarehouse : Dimensional model & SQL

•             Programming : Scala, Python, SQL, Shell

•             ETL tools : Informatica

•             Performance & Cost optimization experience for big data pipeline in the cloud

•             Orchestration : Airflow, Nifi, AutosysMust have been part of a Data Migration project from on-premise to cloud using the above technologies

2.        Must have been part of a Data Migration project from on-premise to cloud using the above technologies

3.        Solid hands on experience on Pyspark and EMR is mandatory.

4.        Excellent articulation and  communication skills

Company Information