- Write traditional code and server-less functions using the language best suited for the task, which is primarily Scala. May include development with C# and T-SQL.
- Build APIs, data microservices and ETL pipelines, to share data with internal and external partners and write interfaces to public data sets to enrich our analytics data stores.
- Participate in building and owning a culture of DevOps and Quality Assurance.
- Continuously document your code, framework standards, and team processes.
- Build and support Data Ingestion frameworks deployed in Azure.
The work / skills:
- Overall we're looking for contracting support that would be somewhere between a skilled analyst / junior data engineer.
- The job would be:
- input:
- a document that specifies how the source file format should be manipulated to match our standard format
- a sample source file
- a template for how the normalization code/configuration should be setup
- output:
a normalization configuration for a given source file format