Required Skills

Azure Data Factory Mapping Data Flows Azure Data Lake Analytics

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 28th Dec 2023

JOB DETAIL

•At least 6 years of relevant experience

•Proven experience being accountable for the building of data /analytics solutions for a given business area how all the components, subsystems, platforms, and integrations fit together to meet the business needs and how the solution fits in with the greater enterprise context.

•Technologies include Azure SQL, Cosmos DB, Azure Data Factory, Power BI, SSIS.

•Good knowledge of Constellation Architecture, Logical & Physical schema, flex tables, etc.  Contractor will be using ERDs to create tables and etl\pipelines.

•Interface across departments to understand the needs and objectives of the business

•Strong experience in data extract transform load (ETL) processes using Azure services, such as Azure Data Factory, SSIS, Azure Data Lake Storage, Azure SQL Database.

•Proficiency in SQL and scripting languages such as Python or PowerShell for data manipulation and transformation.

•Solid understanding of data integration patterns and techniques.

•Experience with data quality management and data governance principles.

•Strong problem-solving skills and ability to work in a fast-paced, collaborative environment.

•Excellent communication skills to effectively convey technical concepts to both technical and non-technical stakeholders.     

 

Responsibilities

•Reporting to the Director of Data Architecture, analyze business and technical requirements, as well as data warehouse data models, to understand the detailed data management requirements

•From the requirements provided, design and implement ETL solutions for extraction and integration of data to and from data warehouses and data marts for the purposes of reporting, decision support and analysis

•Perform regular deployments, scheduled maintenance and housekeeping

•Work with business and analysts and solution architects to identify, design and implement custom user interface programs for data management and extraction purposes

•Manage, monitor and administer database and system performance

•Including optimization and tuning of data loads, extractions and recommending appropriate procedure, query or package changes and optimizations to ensure and improve system performance and reliability

•Manage job and activity schedules to promote optimal performance, maximum availability and minimize data latency and data load durations

•Collaborate with cross-functional teams to understand data requirements and design scalable and efficient ETL processes using Azure services

•Extract data from various sources, transform it into a usable format, and load it into Azure data storage solutions such as Azure Data Lake Storage, Azure SQL Database, or Azure Synapse Analytics

•Develop and maintain data pipelines using Azure Data Factory and other relevant Azure technologies

•Implement data quality checks, data validation, and data cleansing techniques to ensure accuracy and reliability of the data

•Optimize ETL processes for performance and scalability, leveraging Azure services such as Azure Data Factory Mapping Data Flows, Azure Data Lake Analytics, or Azure Synapse Pipelines

•Collaborate with data analysts and data scientists to understand their data needs and provide them with clean, reliable, and well-structured data sets for analysis and modeling

•Perform data quality analysis to ensure data integrity and accuracy of production data

•Ability to proactively identify areas for improvement in data performance, quality, and processing

Company Information