Required Skills

Apache Sparks T-SQL Python PYSPARK MongoDB Json Azure Cosmos

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 4th Feb 2021

JOB DETAIL

Expertise in ETL related development with Big data technologies.
• Must have experience with Apache Sparks, Databricks technologies.
• Must have experience with development in T-SQL & Python and related libraries.
• Experience in development using PYSPARK, Dataframes, structured streaming & Delta with Spark processing.
• Experience in working the relational database as well as document database ( MongoDB Or Cosmos Database)
• Experience in working with different file formats ( parquet, Avro, Json, CSV ) across distributed storage.
• Experience in eliciting, architecting and documenting business logic, ETL architecture, exception handling and fault tolerances in data pipelines.
• Experience in working with messaging systems ( Azure Event Hub, Kafka or Kinesis )

Company Information