Required Skills

hive spark oozie hadoop SQL Spark Spark Streaming

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 18th Nov 2020

JOB DETAIL

Must have strong exp with AWS

Nice to have AWS Certification

Data Engineer will be part of the Data Supply Chain. Big Data Engineer will be responsible for designing & developing data ingestion and data transformation framework for modern data lake solutions. Will be working with structured/unstructured Data sets, building large scale Data processing platforms, implementing world class data governance and operational controls, solving complex performance challenges.

 

  • Experience working with hadoop hive spark and oozie
  • Should have previous experience in developing complex SQL scripts for data analysis and extraction, developing and maintaining programs as required for the ETL process
  • Experience with Spark, SparkSQL, Spark Streaming
  • Good understanding of Hive, HQL, Hadoop, HDFS, Map Reduce
  • Experience in supporting ETL, production data operations (File processing, data distribution etc.,) including debugging, addressing production issues and performing Root Cause Analysis.

Company Information