The purpose of this position is to perform Data Development functions including design new or enhance existing enterprise database systems, maintain or develop critical databases processes, perform unit and system testing, perform support and help desk tasks. It also requires defining and adopting best practices for each of the data development functions as well as visualization and ETL processes. The position is responsible for architecting report solutions using SSRS reports by collaborating with management team. This position is also responsible for architecting ETL functions between a multitude of relational databases and external data files.
ESSENTIAL DUTIES AND RESPONSIBILITIES
- Work with a highly dynamic team focused towards Digital Transformation
- Understand the domain and business processes to implement successful data pipelines.
- Provide work status, and coordinate with Data Engineers
- Manage customer deliverables and regularly report the status via Weekly/Monthly reviews.
- Ability to work in a dynamic environment with changing requirements.
- Good communication and presentation skills
- Working experience with T-SQL and relational databases including currently supported versions of Microsoft SQL Server in Azure.
- Design, develop and maintain Stored Procedures, Functions and Views
- Working experience with development and maintenance of Data Factory data pipelines.
- Working experience with development and maintenance of data pipelines on the Databricks platform in Azure.
- Working experience using DevOps CI/CD in Azure.
- Program in T-SQL with relational databases including currently supported versions of Microsoft SQL Server
- Write high performance SQL queries using Joins, Cross Apply, Aggregate Queries, Merge, Pivot
- Design, develop and maintain Stored Procedures, Functions and Views
- Design normalized database tables with proper indexing and constraints
- Perform SQL query tuning and performance optimization on complex inefficient queries
- Provide guidance in the use of table variable, temporary table, CTE appropriately to deal with large datasets
- Collaborate with DBA on database design and performance enhancements
- Leading in all phases of the software development life cycle in a team environment
- Debug existing code and troubleshoot for issues
- Design and provide a framework for maintaining existing data warehouse for reporting and data analytics
- Following best practices, design, develop, test and document ETL processes
- Develop data cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching
- Keep up-to-date with the latest database features, techniques, and technologies
- Support current business applications including the implementation of bug fixes as needed
- Able to multi-task and adapt to shifting priorities
- Able to meet deadlines set in project planning
- Effectively communicate progress through the project execution phase
- Follow industry and company standard coding practices
- Produce technical and application documentation
- Produce quality deliverables upon deployment
- Other duties as assigned.
QUALIFICATIONS AND REQUIREMENTS
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or abilities.
- Minimum 8 years of work-related experience in T-SQL, SSRS and ETL. If candidate has relevant education in computer science, computer information systems, or related field, lack of experience can be supplemented by education as follows:
- Microsoft Certifications – 1 year
- Associate’s Degree – 1 year
- Bachelor’s Degree – 2 years
- Master’s Degree – 3 years
- Minimum 5 years of experience with development and maintenance of Data Factory data pipelines.
- Minimum 5 years of experience with development and maintenance of data pipelines on the DataBricks platform in Azure.
- Minimum of 3 years of experience using DevOps CI/CD in Azure.
- Understanding of data lakehouse architecture in Azure.
- Experience in developing, maintaining, and supporting database processes using Microsoft SQL Server with emphasis on .NET technologies.
- Proficient at a senior level with the following; T-SQL, SSRS, SSIS, SSAS, Data warehousing, ETL
- Demonstrated ability to perform above listed essential job functions.