US Citizen
Green Card
Corp-Corp
Contract to Hire
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 27th Apr 2023
Data Engineer will be part of Machine learning and data engineering team
Work with raw data – comes from big data platform, bits and bites, traffic data from infrastructure – public cameras
This person will help manage the data pipelines, make them available for AI and ML team.
Need someone with more hands on programming – more upstream where data is in bits and bites, and they need to wrangle it to get it in an more usable format.
Car drives, picks up bits of data for each drive, some is necessary in real time, some later. Take the raw data, save it, or transform and save it so it can be used by AI engineers for planning.
Transform data coming in – cloud, etc. Making it ready for users to work with the data
*drive the car, that is one point of view, but there is also infrastructure data, there are two perspectives, formatting needs to be aligned, the data needs to be synchronized.
Need stronger programming skills – how do I deal with missing data, data that is out of sync
Python is very critical, Java is nice to have, makes it efficient to work with sensors on the vehicles. Knowledge of cloud – AWS - Bachelors degree required.