Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 17th Apr 2024

JOB DETAIL

  • Hands on Experience in Azure Synapse Analytics, Azure Data Factory and Data Bricks, Azure Storage, Azure Key Vault, SQL Pools CI/CD Pipeline Designing and other Azure services like functions, logic apps
  • Linked services, Various Runtimes, Datasets, Pipelines, Activities
  • Strong Hands on Experience in Various Activites like Control flow logic and conditions (For Each, if, switch, until), Lookup, Stored procedure, scripts, validations, Copy Data, Data flow, Azure functions, Notebooks, SQL Pool Stored procedures and etc
  • Strong hands on exp in deployment of code through out landscape (Dev -> QA -> Prod), Git Hub, CI/CD pipelines and etc
  • strong hands on creating the SQL stored procedures
  • Functions, Stored Procedures, how to call one SP into another, How to process record-by-record
  • Dynamic SQL
  • Must have strong background about the Python libraries like PySpark, Pandas, NumPy, pymysql, Oracle, Pyspark libraries
  • Must have strong hands on to get data through APIs
  • Must be able to install libraries and help users to troubleshoot issues
  • Must have knowledge to get the data through stored procedures via Python
  • Should be able to debug the Python code
  • Hands on experioence in Spark Pools, PySpark
  • Should be able to merge data/delta loads through Notebooks
  • Must have strong background about the Python libraries and PySpark

Company Information