10+ years of experience in Data warehousing and Business Intelligence domain with ability collect requirements and translating them into Design & Technical specifications
Must have azure cloud platform hands-on experience
Must have experience in handling the structured and unstructured data
Architect and implement data movement solutions via SFTP, API & JDBC
Data Engineering/Development experience with Very Strong hands on in writing the complex SQLs, , stored procs in azure SQL DW (Synapse) and Azure SQL DB
Strong development hands on background in creating pipelines, data flows and complex data transformations and manipulations using ADF and Pyspark with Databricks
Experience working with different data storage options including Azure BLOB storage , ADLS Gen 2 and Delta Lake etc.
Hands-on experience with Azure Data Factory in building pipelines and orchestrate the pipeline execution.
Create Source to Target Data Mapping rules with the business transformation rules by discussing with business users.
Expert in Agile Data Warehouse using Industry model Framework , Methodology, Data Modeling , create conceptual, Logical and Physical Data Models using Erwin and/or ER Studio Suite.
Expert in Agile software development and release management using Scrum Process, Agile software development Tools such as JIRA.
Good to have familiarity on Azure Analysis services and PowerBI.
Support ML projects from strategy through implementation and on-going improvements.
Perform data collection, analysis, validation, cleansing, developing software in support of multiple machine learning workflows, integrating / deployment of code in a large-scale production environments and reporting.
Designs, codes, tests, debugs, and documents ML code - models, ETL processes, SQL queries, and stored procedures.
Extracts and analyzes data from various structured and unstructured sources, including databases, files, data lakes and external APIs/websites.
Responds to data inquiries from various groups within client’s organization.
Requires experience with relational databases, document databases (NOSQL) and knowledge of query tools and/or statistical software.
Responsible for other duties/projects as assigned by business management / leadership.