Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 16th Dec 2022

JOB DETAIL

This person need strong have strong Apache Airflow and being able to set up the VMs in Azure.  
 
The Data Engineer must have excellent communication skills. 
 

Experience with:  
?         BS Degree in Computer Science or related field 
?         5 years of experience in Data Engineering  
?         Hands-on Python with demonstrated experience working in a data-centric environment 
?         Experience workingwith variety of databases, Postgres is preferred (Teradata, Vertica, Oracleetc.)
?         Experience working inAzure cloud environment and setting up Apache Airflow VMs in the cloud.
?         Experience with Terraform and setting up resources using Terraform scripts in Azure.
?         Experience developing ETL Pipelines with Apache Airflow, getting connections built todifferent data sources (Snowflake, Databricks, MongoDB, Oracle) and pulling inand manipulating data, migrate existing DAGS to the Azure Airflow instance anddevelop new DAGS based on future data needs.
?         Experience with Docker
?         Working with big data pipelines and a batch processing schedulingsystem  
?         Proven success manipulating, processing, and extracting value from complex,disconnected datasets 
?         Good communication skills and experience working cross functionally acrossteams  


Preferred/Nice to Have:
?         Experience optimizing database query performance

Company Information