Required Skills

Databricks Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 29th Apr 2025

JOB DETAIL

*Research and engineer repeatable and resilient ETL workflows using Databricks notebooks and Delta Live Tables for both batch and stream processing

 

*Collaborate with business users to develop data products that align with business domain expectations

 

*Work with DBAs to ingest data from cloud and on-prem transactional databases

 

*Contribute to the development of the Data Architecture for NC DIT - Transportation:

 

**By following practices for keeping sensitive data secure

 

**By streamlining the development of data products for use by data analysts and data scientists

 

**By developing and maintaining documentation for data engineering processes

 

**By ensuring data quality through testing and validation

 

**By sharing insights and experiences with stakeholders and engineers throughout DIT - Transportation.

 

Skill

Required / Desired

Amount

of Experience

 

Excellent interpersonal skills as well as written and communication skills.Required5YearsAble to write clean, easy-to-follow Databricks notebook codeRequired2YearsDeep knowledge of data engineering best practices, data warehouses, data lakes, and the Delta Lake architectureRequired2YearsGood knowledge of Spark and Databricks SQL/PySparkRequired2YearsTechnical experience with Azure Databricks and cloud providers like AWS, Google Cloud, or AzureRequired2YearsIn-depth knowledge of OLTP and OLAP systems, Apache Spark, and streaming products like Azure Service BusRequired2YearsGood practical experience with Databricks Delta Live TablesRequired2YearsKnowledge of object-oriented languages like C#, Java, or PythonDesired7Years

 

Company Information