- Design and implement complex data pipelines in Azure Databricks or similar environments.
- Optimize performance for data processing workflows in Azure cloud environments.
- Lead discussions on data modeling and storage architectures for analytical workloads using tools like Azure Synapse Analytics.
- Apply data governance best practices, including Unity Catalog.
Required Skills & Experience:
- 8+ years of experience in data engineering.
- Expertise in Databricks, Azure Data Factory, PySpark, Python, SQL, and data modeling tools.
- Strong understanding of system design concepts for data architecture.
- Well-versed in Unity Catalog
- Proven ability to handle challenges like performance tuning and complex data pipeline design.
Preferred Qualifications:
- Hands-on experience with Azure Synapse Analytics or similar data warehousing solutions.
- Demonstrated success in designing scalable and efficient data solutions for enterprise environments