Required Skills

PySpark developer Big Data ETL microservices API's.

Work Authorization

  • Green Card

Preferred Employment

  • Corp-Corp

  • W2-Contract

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 30th Oct 2021

JOB DETAIL

For a large financial services client, we are seeking PySpark developer on EMR/AWS to migrate SAS models into SAS. We are looking for hands-on professionals who can build good technical solutions and then roll up their sleeves to implement the solution.
RESPONSIBILITIES:
* Work with business and technical leads on the Transformation of critical Credit Risk Forecasting applications to Microservices AWS EMR Architecture leveraging PySpark.
* Provide guidance on Application Architecture, design and implementation for forecast process for credit loss and home price for Fortune 100 client.
* Work with, lead and mentor the business and technology teams. Build a solution based on cloud, microservices API's. Decompose legacy monolithic systems into Microservices and API's Running in the cloud.
* Experience with converting SAS Code to PySpark ensuring quality and maintainability.
* Experience working in EMR PySpark Performance tuning leverage EMR Architecture (Master, Cluster, and memory utilization)
* Understanding of AWS computing and data architecture to create a sound and high performing implementation for Credit Expense Forecasting Process.
* Experience with Parallel programming with Big Data, ETL, and forecasting models
* Designing API layer using tools like Apigee, AWS API Gateway, API Security, and API Framework.
QUALIFICATIONS:
* At least 5+ years of experience working in a PySpark/EMR environment
* Proficiency with one or more programming languages (Java, Python, PySpark preferred)
* Proficiency in SQL, relational and non-relational databases, query optimization, and data modeling.
* Bachelor degree or equivalent Skills

Company Information