Data Modelling & Analytical skills, Programming on Python, Scala, SQL; Azure, Databricks, Docker & Kubernetes
- Bachelor's degree
- Builds high performance, scalable data products for analytics & Reporting
- Defines data engineering/architecture best practices at a team level
- Follows new industry trends (e.g. Data Engineering) and designs solutions for complex systems to meet ambiguous business needs
- Understand data access patterns, streaming technology, data validation, data modeling, data performance
- Experience working with Azure
- Experience working with Docker and Kubernetes
- Experience working Databricks
- Experience working with Agile delivery practices
- Data orchestration tool such as Airflow
- CI/CD principles
- Version control with Git
- Displays strength in languages such as Python, Scala, SQL
Makes choices across teams to define and apply technology and design standards and best practices