Required Skills

Azure Databricks ADLS pyspark

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 10th Jul 2024

JOB DETAIL

 

Experience in generating data pipelines in Azure ADF
Experience in ingesting data from different Sources using in Azure ADF
Experience in transforming the data using Azure Databricks & Delta lake and Pyspar
Experience in Azure DevOps CI/CD – Stories, Bugs, and Issue management
Implement Integration solution in Microsoft Azure
Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues
Experience working in agile development projects and sprint deliver
Collaborate with cross-functional teams to elicit data requirements and architect effective data pipelines.
Perform data transformations and cleansing operations to ensure data accuracy and consistency.
Evolve existing scripts and notebooks to meet client needs.
Monitor, troubleshoot, and optimize data pipelines for seamless functionality.
Ensure data solutions align with security and compliance standards 
Work closely with data architects to harmonize data models with project objectives.

Company Information