Required Skills

Data Architect

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 13th Sep 2022

JOB DETAIL


Data Lake: ADLS Gen2 (Azure) vs. Databricks Delta Lake (lake house)

Data Warehouse and Analytics: Azure Synapse Analytics vs. Databricks’ Delta Lake & Spark

Machine Learning: AzureML vs. Databricks MLflow
Azure Databricks experience is must.
Good hands-on experience with Kafka
Realtime data processing using Azure Data Stack
Setup input data pipeline with Apache Pulsar(cloud-native, multi-tenant, high-performance solution for server-to-server messaging), Databricks Delta Lake (installed on top of ADLS Gen2), Databricks (for Analytics and DWH)
Configure the data pipeline
Process data end-to-end from data source to warehouse
Mid Client    Anblicks
End Client    Anblicks internal project
Notes / Instructions    Anblicks internal project
Dallas, TX Local

Company Information