- Design, Develop and maintain secure, consistent and reliable ETL solutions supporting critical business processes across the various Business Units.
- Ensure data solutions are compliant with enterprise security standards
- Work in complex multi-platform environments on multiple project assignments.
- Develop and perform tests and validate data flows and prepare ETL processes to meet complex business requirements, including designing and implementing of complex end-to-end solutions using BI platforms.
- Coordinate with analysts and developers to ensure jobs designed and developed meet minimum support standards and best practices before migration into the production environment.
- Partner with various infrastructure teams, application teams, and architects to generate process designs and complex transformations to various data elements to provide the Business with insights into their business processes.
- Uses strategies such as Indexing and partitioning to fine tune the data warehouse and big data environments to improve the query response time and scalability.
- Define and capture metadata and rules associated with ETL processes.
- Assist production support team in providing resolutions to production job failures, data issues and performance tuning
Required Skills & Experience:
- Strong understanding of Data warehousing (Dimensional Modeling, ETL etc.) and RDBMS concepts
- 5+ years working experience with Talend ETL tool
- 5+ years working experience in SQL, Stored Procedures and Table Design
- 5+ years working experience in SQL Query optimization and ETL Data loading Performance
- 2+ years working experience in shell scripting
- Experience in real time streaming technologies is preferred, not required
- Previous Snowflake Cloud Data Warehouse a big plus, not required
- Experience as a Data Engineer in Hadoop Platforms on components like HIVE, KAFKA, NiFi, Spark etc is a big plus, not required
- Experience deploying machine learning models and automating processes in production is a plus, not required
- Experience with cloud technologies(AWS, Azure, GCP) is big plus, not required