- Data Engineer with 10+ years of experience
- Must have good experience in pyspark programming and SQL scripting
- Translate business requirement document, functional specification, and technical specification to related coding
- Must have data migration experience using tools like Azure Datafactory and Databricks
- Must have data pipeline creation on Azure Databricks data processing engine
- Must have good experience in complex sql scripts and stored procedures
- Develop efficient code with unit testing and code documentation
- Ensuring accuracy and integrity of data and applications through analysis, coding, documenting, testing, and problem solving
- Setting up the development environment and configuration of the development tools
- Manage, monitor, and ensure the security and privacy of data to satisfy business needs
- Contribute to the automation of modules, wherever required
- To be proficient in written, verbal and presentation communication (English)
Co-ordinating with the UAT team