Required Skills

Big Data Engineer

Work Authorization

  • US Citizen

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 24th Feb 2023

JOB DETAIL

Strong exposure to Databricks and Python Development is a requirement. More than a senior ETL Engineer, this candidate will be comfortable with change data capture, schema drift, and data governance in a large multi-tenant, low-latency environment.

Design and develop to build a software product that will be integrated and sold/used by their customer base.

Previous corporation or consulting experience is welcomed however someone from a small boutique company or consulting firm would also work well.

Design, Develop, Test, and Deploy

Real-time data, how that feeds into dashboards and tools

Power BI and Python

Hands-on Big Data and BI

 

Mainly Focused on ::

 

Big Data Platform AZURE – Airflow / Python / BI / Data Engineer

Implement and design large-scale data warehouses 2x or more

Big data multi tenet azure data warehouses

Design pipelines CDC – schema drift – semi-and unstructured data

Data lineage

Someone who has done these many times before

The person in this role today has 17 years of experience (tenure leaving) person replacing – so big shoes to fill – this candidate does not have to have this level of experience but they do want someone at least mid-level to senior level

Hoping to obtain – python development – wants as much experience as they can capture – object-oriented, etc.

 

 

Add on info:

8 years of experience with Microsoft Azure data architecture and related solutions (e.g., Azure Data Lake Gen2, Azure Data Factory, CDM, Event Hub, Azure Databricks, Synapse, Azure SQL DW)

Expert knowledge in Power BI, Power BI Embedded, Power BI Services, Power BI Gateway, and Power BI Dataflow

Expert knowledge of designing and implementing large-scale distributed data architecture for OLTP and BI systems

Expert knowledge in data modeling

Advanced knowledge in Azure services including Azure SQL Database, Azure Databricks, Azure Analysis Services, Azure ML Services, and Azure Synapse Analytics

 

Company Information