Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 5th Dec 2023

JOB DETAIL

Taking on prem data to the cloud through data factory

  • Traditional ETL work – not an official data warehouse (but think of them like a DW)
  • Kafka very required
  • Microsoft SQL Server
  • Postgres in the cloud
    • Some postgres would be very helpful but not required
  • Docker/YAML files are good but not required
  • If they are Python – stay away from big data/open source oriented work
    • No Spark, HIVE, etc

 

Shifting some patterns to real time

-        Kafka is kind of new (from Azure Service Bus – this won’t matter anymore to him)

o   The complexity isn’t very high but they need expertise with the data scenarios

§  Who are they coded optimally for weird scenarios, what does xyz data mean, etc

·        If they deploy his…will it blow away a table for 4 minutes?

-        Soft skills of being proactive and seeking out work vs waiting for work to come to them

o   Independent workers

o   Willing to go above and beyond as a norm

 

Duration: intended to be managed capacity with ongoing work for years

 

Company Information