Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 21st Jul 2022

JOB DETAIL


Total experience 6 years with 2 to 3 years working experience in data integration and pipeline development with data warehousing .
Experience with AWS Cloud on data integration with EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems
Strong real-life experience in python development especially in pyspark in AWS Cloud environment.
Experience on Databricks 
Design, develop test, deploy, maintain and improve data integration pipeline.
Experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
Experience with source control systems such as Git and Jenkins build and continuous integration tools.
Experience with continuous deployment(CI/CD)
Knowledge of Airflow is a plus.
Exposure to ETL tools including Informatica and any other is preferred

Company Information