Required Skills

Big Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 18th Aug 2022

JOB DETAIL

 

Volume of patients is large
Need to build ETL pipeline to transform and massage data and build data models
They will be working with Data Scientists
 
Stack:
Spark is most important
Java Python or Scala (any of the three is fine)
Real time and batch system experience – Kafka
SQL
GCP is preferred – any cloud experience is okay
Airflow preferred – need some sort of orchestration tool. Need to have experience with complex data and complicated ETL pipelines.

Company Information