JOB RESPONSIBILITIES:
The Senior Data Engineers will help in developing high performance & high scalability enterprise applications using one or more leading cloud platforms across SaaS and PaaS. They will be working closely with the data architects to jointly develop the data architecture and ensure security and maintenance. Their role also involves diagnosis of existing architecture and data maturity and help the organization in identifying gaps and possible solutions. They will also work with data scientists and business leadership to develop data pipelines for model development and productionalization. Their work will involve high level of interface with business heads and corporate leadership
- Gather requirements, assess gaps and build roadmaps and architectures
- Lead teams of 2-3 associate data engineers in the project building and delivery process
- Explore suitable options, design, and create data pipelines (data lake / data warehouses) for specific analytical solutions
- Define ETL / ELT based on jointly defined requirements
- Identify gaps and implement solutions for data security, quality and automation of processes
- Support maintenance, bug fixing and performance analysis along data pipeline
- Build and manage cloud data services
REQUIRED EDUCATION AND EXPERIENCE:
- Bachelor's degree in Computer Science, Engineering, Mathematics or Statistics. Master's degree preferred
- Experience in using SQL, PL/SQL or T-SQL with RDBMSs like Teradata, MS SQL Server, or Oracle in production environments.
- Experience with Python
- Limited Experience in using Microsoft Azure/AWS or other leading cloud platforms
- Experience in maintaining and configuring data engineering and ETL tools
- Experience with data tools such as Hive, Spark, Hadoop, or Presto
- 3+ years working in the data engineering field
- Ability to work well in agile environments in diverse teams with multiple stakeholders
- Strong project management and organizational skills
- Ability to effectively communicate complex analytical and technical content
- High energy and passionate individual who inspires teammates to reach their maximum potential
- Excited about trying new solutions outside standard approved
- Willing to adopt an iterative approach; experimental mindset to drive innovation