US Citizen
Green Card
Corp-Corp
W2-Permanent
W2-Contract
Contract to Hire
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 16th Dec 2022
This person need strong have strong Apache Airflow and being able to set up the VMs in Azure.
The Data Engineer must have excellent communication skills.
Experience with:
? BS Degree in Computer Science or related field
? 5 years of experience in Data Engineering
? Hands-on Python with demonstrated experience working in a data-centric environment
? Experience workingwith variety of databases, Postgres is preferred (Teradata, Vertica, Oracleetc.)
? Experience working inAzure cloud environment and setting up Apache Airflow VMs in the cloud.
? Experience with Terraform and setting up resources using Terraform scripts in Azure.
? Experience developing ETL Pipelines with Apache Airflow, getting connections built todifferent data sources (Snowflake, Databricks, MongoDB, Oracle) and pulling inand manipulating data, migrate existing DAGS to the Azure Airflow instance anddevelop new DAGS based on future data needs.
? Experience with Docker
? Working with big data pipelines and a batch processing schedulingsystem
? Proven success manipulating, processing, and extracting value from complex,disconnected datasets
? Good communication skills and experience working cross functionally acrossteams
Preferred/Nice to Have:
? Experience optimizing database query performance