Required Skills

parquet Avro Json CSV MongoDB Azure Event Hub Kafka

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 4th Feb 2021

JOB DETAIL

Description:

·         Expertise in ETL related development with Big data technologies.

·         Must have experience with Apache Sparks, Databricks technologies.

·         Must have experience with development in T-SQL & Python and related libraries.

·         Experience in development using PYSPARK, Dataframes, structured streaming & Delta with Spark processing.

·         Experience in working the relational database as well as document database ( MongoDB Or Cosmos Database)

·         Experience in working with different file formats ( parquet, Avro, Json, CSV ) across distributed storage.

·         Experience in eliciting, architecting and documenting business logic, ETL architecture, exception handling and fault tolerances in data pipelines.

·         Experience in working with messaging systems ( Azure Event Hub, Kafka or Kinesis )

 

Company Information