Data Engineer, you will design, develop, test and maintain efficient and sustainable data pipelines to keep data accessible and ready for analysis.
Working closely with the Analytics Team, you will engage with business teams to understand requirements, design conceptual, logical and physical data models, build and deploy data pipelines best suited to the requirements.
Perform root-cause analysis and recommend solutions to fix data related issues.
This will be a hands on role utilizing Extract, Transfer & Load (ETL) tools to deliver source to target mappings, physical and logical data models and related scripts to automate the data transformation and loading processes. Essential job functions
Work closely with data experts to build and maintain data pipelines, KPI data dictionary, metadata, data standards, and ensure adherence to the Plans Analytics methodologies and highest data quality standards.
Engage business teams to understand requirements, document them and deliver robust and scalable solutions in the form of data models that can be leveraged for self-service analytics.
Explore ways of modeling the Plans unstructured voice and text data into frameworks fit for analysis.
Design conceptual, logical and physical data models, maintain data dictionary and capture metadata.
Perform gap analysis as needed for purposes of maintaining, continuously enhancing data models and integrating KPI’s into the analytics platform as and when new KPI and business metrics are adapted by the organization.
Work with application developement team to deploy analytics data products through such ways as embeding analysis models into business applications and mobile solutions.
Establish and maintain provenance, integrity and security of data used for self-service reporting, ad-hoc analysis or other levels of analysis.
Utilize ETL tools and other data pipeline automation techniques to develop and maintain source to target mapping