Qualifications:
- 9+ years of hands-on experience designing and implementing data engineering solutions using Azure cloud offerings including Data Factory, Azure Synapse, ADLS, and Azure Functions and Logic Apps.
- In-depth understanding and experience in data engineering and data warehousing best practices, data modeling, data security, and governance principles throughout the data lifecycle and on development experience with Relational DBs (MS SQL Server, PostgreSQL, Oracle), as well as complex stored procedures and functions using SQL and optimization of SSIS packages and Redshift database queries.
- Experience designing and building data pipelines using APIs, Big Query, and Streaming ingestion methods. Proficiency in Spark, and Python and ability to work with telemetry using Azure monitor, and app insights.
- Solid understanding of DevSecOPS, Git integration, Code deployment using CI/CD pipelines, and managing work in an agile environment using Azure Boards, and Confluence.
- Ability to troubleshoot and deploy using Redgate tools and Visual Studio is a must.
Additional qualifications are a plus:
- Familiarity with Modern Data Platforms technologies like Snowflake, Matillion, Bryte Flow, and Tableau is a plus.
- Knowledge of Azure IoT, Azure HDInsight + Spark, Kafka, and Azure Stream Analytics is a bonus.
- Experience with Informatica - IICS task flow development and maintenance.
- Data bricks, Microsoft Azure Data Engineer, and/or other cloud certifications.