Required Skills

Spark Python SQL-Snowflake S3 EC2 Lambda SQS

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 23rd Dec 2020

JOB DETAIL

Job Position: Big Data Engineer
Job Location: Whippany, NJ
Interview Process (Is face to face required?)
Yes

Must Have Skills
• Must have at least 5 - 6 years of experience in development, design, administration, configuration, design and architecture of the following:
· Big Data and Distributed Processing Technologies and framework ( Spark, Python, SQL-Snowflake)
· AWS Cloud Services (S3, EC2, Lambda, SQS)
· Experience with Data preparation tools such as Trifacta & Alteryx & Understanding of Tableau for reporting

Nice to Have Skills
· Linux Administration (Ability to troubleshoot OS issues)
· Data Science and Machine Learning ( Familiarity with Data preparation and Feature Engineering techniques, Understanding of Machine learning techniques)
· Understanding of SAS & R programming languages.

Detailed Job Description
Onboard large volumes of data (Terabyte scale) in an agile fashion

(ingest Data from source to S3, Use Spark for Data Validation and Preparation, use spark/ Bulk load for Data loading to snowflake)
· Provide application, tool and Infrastructure support to Data Stewards and Data Scientists
(Resolve issues related to tools, resolve data connectivity issues, Provision Infrastructure for Data processing needs)
· Provide solutions around Big Data processing, Data Management & Data Science use cases.

Minimum years of experience
5+

Certifications Needed :No

Top 3 responsibilities you would expect the Subcon to shoulder and execute
Onboard large volumes of data Terabyte scale in an agile fashion
Provide application, tool and Infrastructure support to Data Stewards and Data Scientists
Provide solutions around Big Data processing, Data Management Data Science use cases.

Company Information