- 6+ years of working experience in data integration and pipeline development.
- 6+ years with Python/PySpark/Data Bricks
- 2+ years of Experience with Azure Cloud on data integration with Apache Spark
- Strong experience in python development especially in pySpark
- Design, develop test, deploy, maintain and improve data integration pipeline.
- Python, PySpark, Hive, Hadoop, Java, Tableau
- Experience in Python and common python libraries.
Strong analytical experience with databases in writing complex queries, query optimization, debugging, user-defined functions, views, indexes, etc.
- Have experience interacting with business stakeholders and customers directly.
- Experience in Agile project development methodologies.