Design & Build Cloud infrastructure, and data management processes to move the organization to a more sophisticated, Agile, and robust target state data architecture
Develop systems that ingest, cleanse, and normalize diverse datasets, develop ETL/ELT data pipelines from various internal and external data sources
Develop understanding of how data will flow & stored through an organization across multiple applications
Design & develop data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities
Develop POCs to influence platform architects, Business Stakeholders, and software engineers to validate solution proposals and migrate
Work with data and analytics experts to strive for greater functionality in our data systems.
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Constantly assist other writers in developing knowledge and sharing expertise
Identify data engineering needs and implement optimal solutions.
Develop data sets for specific analysis projects, dashboards and applications, and general reuse.
Automation of data management processes
CI/CD Pipelines for automated deployment
Migration of on-premise systems to cloud using Big Data Technologies
Project planning & execution using Agile methodologies. Design & Build Cloud infrastructure, and data management processes to move the organization to a more sophisticated, Agile and robust target state data architecture
Develop systems that ingest, cleanse, and normalize diverse datasets, develop data pipelines from various internal and external sources
Develop good understanding of how data will flow & stored through an organization across multiple applications
Design & develop data management and data persistence solutions for application use cases leveraging relational, non-relational databases and enhancing our data processing capabilities
Develop POCs to influence platform architects, Business Stakeholders, and software engineers to validate solution proposals and migrate
Work with data and analytics experts to strive for greater functionality in our data systems.
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
Constantly assist other writers in developing knowledge and sharing expertise
Identify data engineering needs and implement optimal solutions.
Develop data sets for specific analysis projects, dashboards and applications, and general reuse.
Automation of data management processes. Optimize the existing processes with creative and innovative ideas
Migration of on-premises systems to cloud using Big Data Technologies
Project planning & execution using Agile methodologies. Provide timely status reporting with management and business partners.
Process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Enable Data Scientist & Business users to run their processes efficiently
Process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Enable Data Scientist & Business users to run their processes efficiently
Build environment to support development, System Testing, UAT and Production, cycle phases using SDLC methodologies.
Manage and maintain the overall project tasks and timeline. Ensure all project milestone dates are agreed upon and achieved.
Experience in deploying application on Docker and Containers
Experience in deploying and managing various AWS services EC2, EMR, S3, ECR, ECS, Redshift and No SQL DB
Automated Deployment and code versioning tools like Jenkins, Git etc.