As a Senior Data Engineer at Client , you will play a critical role in designing, developing, and maintaining our data infrastructure. You will be responsible for data integration, migration, and analysis using a variety of Microsoft technologies. This role requires a deep understanding of Azure Data Factory, Logic Apps, Azure Service Bus, Databricks, and advanced SQL. You will work closely with the Data Lead and Technical Analyst to translate business requirements into technical solutions and ensure the seamless flow of data across our systems.
Key Responsibilities:
- Design, develop, and maintain data pipelines using Azure Data Factory, Logic Apps, and Azure Service Bus.
- Implement and manage Databricks for advanced data processing and analytics.
- Develop complex SQL queries and stored procedures for data extraction, transformation, and loading (ETL).
- Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.
- Ensure data quality and integrity across various data sources and systems.
- Manage data integrations and migrations between diverse systems, ensuring minimal disruption to business operations.
- Utilize Azure CI/CD pipelines for continuous integration and delivery of data solutions.
- Create and maintain data workflows using Power Automate.
- Conduct data analysis to support business decision-making processes.
- Work independently and as part of a team to deliver high-quality data solutions.
- Communicate effectively with stakeholders to understand their data needs and provide technical guidance.
Required Skills and Qualifications:
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Proficiency in Azure Data Factory, Logic Apps, Azure Service Bus, Databricks, and advanced SQL.
- Experience with developing and optimizing stored procedures.
- Strong understanding of Azure CI/CD pipelines and best practices.
- Proven experience in data integration and migration between various systems.
- Proficiency in using Power Automate for workflow automation.
- Excellent data analysis skills.
- Ability to work independently and manage multiple tasks simultaneously.
- Strong collaboration skills and the ability to work effectively with cross-functional teams.
- Ability to communicate complex technical concepts to non-technical stakeholders.
- Strong problem-solving skills and attention to detail.
Preferred Skills:
- Extensive experience with the overall Azure suite of products.
- Proficiency in SQL Server Analysis Services (SSAS) and SQL Server Management Studio (SSMS).
- Experience with Microsoft Dynamics 365 and CRM data migration.
- Familiarity with PowerApps for building custom business applications.