Skills (bold are key skills)
- Strong skills in Python Programming
- this includes strong fundamentals on setting up python projects leveraging virtual environments,
- resolving version conflicts of python and libraries,
- understanding of libraries,
- writing effective configurable modular code,
- should be able to guide other team members etc.,
- DataBricks Service (on any cloud, preferably Azure)
- PySpark programming experience
- Strong SQL Experience
- Apache Airflow Experience
- Snowflake (may not be expert)
- CI/CD Experience with Jenkins Pipelines, Code Coverage, Scans etc.,
- Less dependent and self-learner on new technologies as we may adapt in future (like Kuberenetes, Docker etc.,)