Required Skills

Data Engineer Python Scala Spark AWS

Work Authorization

  • Us Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 6th Jan 2021

JOB DETAIL

Role:   Data Engineer 

Location:  Wilmington,  Delaware,  

Duration:6 months 

Visa: USC/GC

Interview:  Glider Assessment à 1 and done Video Interview

(Data Engineers):

Roles are in Wilmington, DE only (but MAY consider other locations for rare instance)

Looking for data engineers to migrate legacy on prem platform and modernizing to cloud.  A lot of Ab Initio data needs to be manipulated and moved to AWS.

Python-MUST, Scala, Spark, AWS (ECS, EC2, EMR, Lambdas, etc).

If they don’t have Spark but solid Python that’s OK.  If they don’t have Python, but solid Java and Py-Spark, will consider that

CI/CD pipeline with Jenkins

5+ yyears' experiencewith Data Engineering

Good understanding of data and data analysis, how data flows, how data is joined, etc

As Is and To Be experience

Minimum Requirements:

Atleast 3 years of experience developing Data Pipelines for Data Ingestion or Transformation using Java or Scala or Python

At least 2 years' experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC etc..)

At least 3 years of developing applications with Monitoring, Build Tools, Version Control, Unit Test, TDD, Change Management to support DevOps

At least 3 years of experience with SQL and Shell Scripting experience

At least 2 years of experience with software design and must have an understanding of cross systems usage and impact

Nice to Have qualifications:

2+ years of experience working with Dimensional Data Model and pipelines in relation with the same

2+ years’ experience with Amazon Web Services (AWS), Microsoft Azure or another public cloud service

2+ years of experience working with Streaming using Spark or Flink or Kafka or NoSQL

Intermediate level experience/knowledge in at least one scripting language (Python, Perl, JavaScript)

Hands on design experience with data pipelines, joining data between structured and unstructured data

Company Information