US Citizen
Green Card
EAD (OPT/CPT/GC/H4)
H1B Work Permit
Corp-Corp
W2-Permanent
W2-Contract
Contract to Hire
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 29th Apr 2025
*Research and engineer repeatable and resilient ETL workflows using Databricks notebooks and Delta Live Tables for both batch and stream processing
*Collaborate with business users to develop data products that align with business domain expectations
*Work with DBAs to ingest data from cloud and on-prem transactional databases
*Contribute to the development of the Data Architecture for NC DIT - Transportation:
**By following practices for keeping sensitive data secure
**By streamlining the development of data products for use by data analysts and data scientists
**By developing and maintaining documentation for data engineering processes
**By ensuring data quality through testing and validation
**By sharing insights and experiences with stakeholders and engineers throughout DIT - Transportation.
Skill
Required / Desired
Amount
of Experience
Excellent interpersonal skills as well as written and communication skills.Required5YearsAble to write clean, easy-to-follow Databricks notebook codeRequired2YearsDeep knowledge of data engineering best practices, data warehouses, data lakes, and the Delta Lake architectureRequired2YearsGood knowledge of Spark and Databricks SQL/PySparkRequired2YearsTechnical experience with Azure Databricks and cloud providers like AWS, Google Cloud, or AzureRequired2YearsIn-depth knowledge of OLTP and OLAP systems, Apache Spark, and streaming products like Azure Service BusRequired2YearsGood practical experience with Databricks Delta Live TablesRequired2YearsKnowledge of object-oriented languages like C#, Java, or PythonDesired7Years