• Citizen

• Full Time

• Direct Hire

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 23rd Mar 2022

Mandatory skills :

-Data Engineer with AWS using Glue and Spark, Apache Airflow, NiFi, S3, Lambda, MySQL + Scrum master as nice to have.

- Design and Implement end-to-end ETL solutions on AWS using Glue and Spark for data preparation and feature engineering of data science projects.

- Be comfortable to convert SQL, Pandas code that data scientists use in experiment notebooks to proper pyspark applications.

- Develop and maintain data orchestration pipelines using Apache Airflow and data ingestion using NiFi.

- Improve on existing software, enhance code quality and organize code structure.

- Implementation of unit and integration tests - Test Driven Development.