Assisting in the development and execution of data conversion, migration and ETL procedures to effectively migrate data from on-premise systems to the Azure Data Lake using Azure Data Factory (ADF).
Produce high quality ETL code on time and on target
Perform ETL by designing, developing various SQL Server Integration Service (SSIS) packages to extract and transform data; scheduling SSIS packages and executing them via ADF.
Developing and modifying reports used for data conversion
Developing and modifying ETL pipelines built on Azure data Factory
Developing and modifying customized T-SQL Server procedures supporting the Enterprise Environment
Work closely with the Azure Administrators to support the deployment of data to higher environments
Work in a dynamic Agile/Scrum/Extreme programming team environment
Applying DevOps best practices
Documenting work as required following development standards
Bachelor’s Degree or higher in Computer Science or related area.
6+ years’ experience in IT in Data Engineering related roles
Experience in the development and execution of ETL in SQL Server environments working with SQL Server Integration Services.
Experience performing data conversion/migration within in an Azure Cloud environment. (Experience working with the Azure Data Factory (ADF) tool a strong asset).
Previous experience in the planning and execution of large-scale critical data conversion and migration initiatives
Experience designing, developing and scheduling various SSIS packages to extract and transform data.
Demonstrated experience in the areas various areas listed above (Preparation, Development, Testing, Execution and Post-Go-Live Support).