Create and maintain highly scalable data pipelines across Azure Data Lake Storage, and Azure Synapse using Data Factory, Databricks and Apache Spark/Scala.
Responsible for managing a growing cloud-based data ecosystem and reliability of our Corporate datalake and analytics data mart.
Contribute to the continued evolution of Corporate Analytics Platform and Integrated data model.
Identify gaps and weaknesses in our data stack and continue to guide learning advancements for the team.
Provide technical expertise and leadership to Data Engineering team in all phases of work including analysis, design and architecture to develop and implement cutting-edge solutions.
Negotiate and influence changes outside of the team that continuously shape and improve the Data strategy.
Required Skills :
7+ years of experience in tier 1 or 2 IT services companies or Tier 1 captives
7 years of experience implementing analytics data Solutions leveraging Azure Data Factory, Databricks, Logic Apps, ML Studio, Datalake and Synapse
Working experience with Scala, Python or R
Bachelor’s degree or equivalent experience in Computer Science, Information Systems, or related disciplines