Tagcor

DATA ENGINEER

10 years of experience
Microsoft experience is a MUST with last 3-4 years
Should have experience in using Pyspark Working experience on KUSTO for telemetry data
Should be able to write python code in Azure Synapse Notebook.
Good understanding working experience of Azure Synapse end-to-end.
Should have experience in working with Spark structured streaming data possibly from Event hubs
Should have experience in handing large volume of data possibly in 100s of GB
Should be able to debug and fine tune the jobs note book for optimum memory consumption and processing.
Should have knowledge of Data warehousing, data management for efficient data handling.
Should have good knowledge of data modeling data engineering work
Experience working with large data sets using SQL Azure Data Lake PySpark ADF Synapse, etc., to derive actionable insights is highly desirable.
They should be productive soonest possible post joining.