Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 29th Nov 2022

JOB DETAIL


1 to 3 years working experience in data integration and pipeline development with data warehousing .
.Experience withAWS Cloud on data integration with Databricks, Apache Spark, EMR, Glue, Kafka,Kinesis, and Lambda in S3, Redshift, RDS, MongoDB / DynamoDB ecosystems
· Strong real-life experience in python development especially in pySpark in AWS Cloud environment.
. Design, develop, test, deploy, maintain and improve data integration pipeline.
. Experience inPython and common python libraries.
· Strong experience with Perl and Unix Scripts.
·Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.
· Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools.
· Experience with continuous deployment(CI/CD)
· Databricks,Airflow and Apache Spark Experience is a plus.
· Experience with databases (Oracle, SQL Server, PostgreSQL, Redshift, MySQL, or similar)
· Strong experience with performance tuning, analytical understanding with business and program.
· Exposure to ETLtools including Informatica and any other .
· BS/MS degree inCS, CE or EE.

Company Information