Required Skills

ETL SSIS SSAS Python Azure Data Factory ADLS EDI Databricks Powershell Synapse/Snowflake

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 29th Dec 2020

JOB DETAIL

Role: Senior ETL Data Engineer

Location: Remote

Must have skill: ETL SSIS, SSAS, Python, Azure Data Factory, ADLS, EDI, Databricks, Powershell, Synapse/Snowflake

 

Experience in tools like Azure Data Factory, Databricks, Python, Powershell, Synapse/Snowflake/EDW solutions. Client is into a complete Microsoft shop working within Azure and they need someone that has a lot of familiarly with Azure tooling. They aren’t looking for someone with just SSIS experience and will need someone that is used to working with lots of different data files in different formats whether they are consumed raw or need some pre-processing.

 

Job Description:-

 

·         Competence in writing clean, bug-free code as per defined standards (appropriate variable declarations, class/method design, non-redundant and optimized code)

·         Ability to write unit test cases and test their code accordingly

·         Awareness of technologies used in their project and  coding practices and tools

·         Ability to translate design/program specification to clean code

·         Knowledge of using code repository tools and build automation

·         Communicating promptly and clearly with all stakeholders

·         Maintaining a cohesive spirit to accomplish team responsibilities

·         Accurately reporting status of assignment and escalating issues and risks in a timely manner

·         Learnability (ability to learn new things quickly with minimal assistance)

·         Keeping abreast of latest technologies and trends

 

Please see some important updates on the Data Engineer/ETL Developer role with Oncology Analytics.

We’re looking for a candidate who is strong in ADF. Able to look at the SSIS package and migrate to ADF.  Able to handle challenges in migration activity.

Has worked in ADLS and Azure Synapse. Source should be ADLS and target should be Azure Synapse.

Candidate should have knowledge of PowerShell scripting to automate the processes.

Candidate should have 70% of ADF experience and 30% of ADLS and Synapse

Further, we’re adding to questions recruiters can ask candidates:

Which version of ADF have you worked with? (V1 or V2)

Which are different data formats processed? (XML,CSV,JSON etc)

What is your experience with different Azure Services? How long you are working on ADF?

How good you are in writing Stored procedure in Synapse or in Sql Server?

In regards to Azure Data Factory, ADLS (Data Lake) and Synapse, here are a few questions to ask:

  1. Have you worked within Azure Data Factory (ADF) to develop, test and deploy production pipelines?
  2. In ADF have you created dynamic data processing pipelines that were heavily parameter driven based on configuration data/values (source, target, etc.) stored in database tables?
  3. What challenges have you discovered when converting SSIS packages to ADF and how did you solution them?  (an example is in SSIS there is an object called “Execute SQL” that does not exist in ADF)
  4. How have you used ADLS in the past?  IF so how did you use it with ADF?
  5. Do you have Synapse experience, if so, explain and provide examples of how it was used with ADLS and ADF (ADLS is typically a source and Synapse is typically the target, where ADF is the transport between them)
  6. Do you have PowerShell scripting experience?  If so, explain how you have used it in the past for automation.

We are looking for fairly understandable and direct answers to the above questions with specific examples for each.  As a recruiter you don’t need to technically understand the answer, we just want to see if they can provide one and describe what they did in some specifics when challenged.  Experience in ADF is the most critical. 

Company Information