Required Skills

data engineering Azure Data Lake Storage Azure Data Factory

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 8th Sep 2023

JOB DETAIL

  • Azure Databricks
  •  
  • Streaming experience

•             Data Engineer with a combination of expert SQL skills and software engineering expertise.

•             Extensive experience coding data pipelines and transformations in PySpark/SQL on the Azure Databricks platform.

•             Technical expert in data lake technology and distributed computing architectures (Apache Spark).

•             In-depth knowledge of Azure cloud services related to data engineering and analytics, such as Azure Data Lake Storage, Azure Data Factory, Azure Databricks, Azure                  SQL.

•             Comfortable working with diverse data stores including RDBMS, NoSQL DBs, ADLS Gen2, Parquet, CSV, Delta tables.

•             Knowledge of data integration patterns and approaches (APIs, Microservices, Pub/Sub, Batch, Streaming, etc.).

•             Knowledge of Unity Catalog and data governance standards.

•             Experience with Development Tools for CI/CD, Unit and Integration testing, Automation and Orchestration.

•             Some experience working with Power BI for reporting and visualizations.

Company Information