• US Citizen

• Green Card

• Corp-Corp

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 9th May 2022

Note: PySpark, Spark, SQL is a must
As senior member of the Data Engineering team, you will guide the team to design, develop, deploy and scale innovative Data warehouse and ETL solution using Azure Databricks.
Work with Microsoft data solutions software stack (Azure Databricks, Azure SQL Server, Azure Data Lake Gen 2, Azure Synapse, Azure CosmosDB, Azure Analysis Service, Azure Data Factory).
Works with reporting team to design optimized Data warehouse solution for reporting use cases.
Build and maintain release pipeline (CI/CD) in Azure DevOps for all the technology stacks.
Responsible for quality and reliability of deployed ETL pipelines and Data warehouse Work with other BI developers and analysts in delivering value to the company and the different stakeholders.
Comply with the procedures and processes used within the Data Engineering team, ensuring all work undertaken is executed consistently and professionally Perform Business Intelligence duties including but not limited to business analysis, information analysis, data extraction, loading and transformation (ETL), data modelling, data cube development, report development, system monitoring, user training and documentation.
SKILLS WE SEEK
Expert in writing SQL Query including understanding of leveraging index and partitions.
Experience in delivering Data Engineering work using Databricks or any other Apache Spark platform.
Experience with streaming data processing.
Experience working with APIs as both source and target.
Experience working in Azure environment (focusing on Azure SQL Database, Azure Data Lake Gen2, Azure Data Factory, Azure Analysis Service, CosmosDB, Azure Event Hub).
Worked with GIT and CI/CD pipeline (preferable Azure DevOps / VSTS).
Data analysis, data modelling, data integration, data warehousing and database design.
Experience in Power BI or equivalent reporting tool (Tableau).
Proven ability to work in a team as well as autonomously.
Strong problem-solving skills and determination to provide solutions to problems.
Proven drive for self-learning - you will be provided with training and coaching required to succeed but your success will be helped by your self-driven & ambitious mentality.
Desirable: B.S./M.S. in Computer Science or equivalent and experience working with Talend.
******* Note: PySpark, Spark, SQL is a must.