This role requires expertise of both Platform and Data Engineering. Develop and deliver Data engineering solutions to ingest and provision data to/from Cloud Data platforms. Design, develop and deliver cloud Data Platform solutions and develop/manage automation pipelines to handle Data Engineering needs.
Data Engineering functions:
- Design, Develop and deliver data engineering solutions and develop automation pipelines to ingest or provision data to or from Cloud platforms.
- Collaborates with Business Analysts and Product Managers to identify business requirements in designing efficient data pipelines and interfaces.
- Partner with other developers, various system administrators to ensure effective implementation of the data pipelines according to the business needs.
- Ensure data pipelines account for high data quality and reliability.
- Develops data solutions on-time and documents necessary information for operational effectiveness.
- Ensure sensitive data is processed and stored using secure data processing pipelines as required by Nuveen/TIAA Cybersecurity
- Implement version management and deployment of data pipelines using Nuveen approved CI/CD methodologies.
Platform Engineering functions:
- Facilitate setup of Data Lake platform and enable the platform with required security controls including encryption, masking, certificate/keys rotation etc.
- Practice Infrastructure as code(IaC) to develop automation routines and integration flows to manage state of the Data Lake platform systems.
- Collaborates with developers, analysts, various system administrators to identify system requirements in designing efficient Data Platform solutions and interfaces.
- Identifies, implements, and documents all system constraints, implications, and consequences of various proposed system changes.
- Guides platform users with the ongoing operation, maintenance, and enhancements on the platform. Evaluates the efficiency and effectiveness of Platform operations and handles troubleshooting of problems.
- Responsible for development of cloud integrations and data migrations to support operations of Cloud infrastructure, provisioning, monitoring with IaaS and PaaS models.
- Deploy, automate, maintain, and manage AWS cloud-based systems across SDLC environments, to ensure the availability, performance, scalability, and security of the Data Lake Platform.
- Manage the governance framework for DB-Services specific to private, hybrid and public cloud platform adhering to standards and integration with existing tools.
- Perform Platform and Data Engineering L3 support.