Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 8th Feb 2023

JOB DETAIL

  • We need Data Engineer with hands-on experience in PySpark to build data pipes in AWS environments.

  • Should be able to write design documents and independently build the Data Pipes based on the defined Source to Target mappings.

  • The candidate should have good exposure to RDBMS and able to convert complex Stored Procedures, SQL Triggers, etc. logic using PySpark in the Cloud platform.

  • The candidate should be open to learn new technologies and implement solutions quickly in the cloud platform.

  • Any knowledge of the Palantir Foundry Platform will be a big plus.

  • Communicate with program key Stakeholders to keep the project aligned with their goals.

  • Effectively Interact with QA and UAT team for code testing and migrate to different regions.

  • 4-5 years of hands-on experience in PySpark to build data pipes in AWS environments.

  • Expert in writing shell scripts to execute various job scheduler

  • Basic understanding of Informatica Mapping and Workflows

  • The candidate should able to convert complex Stored Procedures, SQL Triggers, etc. logic using PySpark in the Cloud platform.

 

Company Information