• US Citizen

• Green Card

• Corp-Corp

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 17th Jun 2022

* Must be a team player.

SCALA

SQL

Spark/Spark Streaming

Big Data Tool Set

Linux

Python/PySpark

Kafka

* Experience collaborating with dev team, project managers,and engineers.

* Excellent communication and teamwork skills

Essential Job Functions:

- Designand development of data ingestion pipelines (Databricks background preferred).

-Performance tune and optimizethe databricks jobs.

-Evaluate new features and refractors existing code.

-Mentor junior developers and makes sure all patterns aredocumented

- Performdata migration and conversion activities.

- Develop and integrate software applications using suitabledevelopment methodologies and standards, applying standard architecturalpatterns, taking into account critical performance characteristics and securitymeasures.

- Collaborate with Business Analysts, Architects and SeniorDevelopers to establish the physical application framework (e.g. libraries,modules, execution environments).

- Performend to end automation of ETL process for various datasets that are beingingested into the big data platform.

* Maintain and support the application.

* Must be willing to flex work hours accordingly to supportapplication launches and manage production outages if necessary

* Ensures to understand the requirements thoroughly and indetail and identify gaps in requirements

* Ensures that detailed unit testing is done, handlesnegative scenarios and document the same

* Work with QA and automation team.

* Works on best practices and documenting the process

* code merges and releases (Bitbucket)

* Works with architect and manager on designs and bestpractices

* Good data analysis skills.