Develop ELT data pipeline to migrate applications using DBT and Snowflake framework
Scheduling and dependency management of data pipeline with proper auditing
Automation of manual process using Python and other technologies
Implement test automation in the data pipeline.
Build detailed technical design, conduct analysis, development of applications and proof of concepts.
Responsible for translating functional ETL requirements into a technical design document, building the DataStage jobs and sequences to pull data from the source into staging tables, from staging tables into historical tables using Change Data Capture methodologies, and then from historical tables into dimensional data marts for reporting.
Communicate progress across organization and levels from individual contributor to senior executive.
Identify and clarify issues/problems that need action and drive appropriate decisions and actions relating to system integrations, compatibility, and multiple platforms.
Research, test, build, and coordinate the conversion and/or integration of new products based on client requirements.
Design and develop new software products or major enhancements to existing software.
Overseeing the testing, implementation, maintenance, and enhancement of the applications.
Consult with project teams and end users to identify any further application requirements.
Troubleshoot and resolve software issues and respond to suggestions for improvements and enhancements.
Instruct, assigns, directs, and checks the work of other software developers on development team.
Participate in development of software user manuals.
Design and build applications as per the given requirement adhering to the guidelines.
Ensure consistent unit testing and support the technology infrastructure team implementation.
Preferred Qualifications
Bachelor’s Degree or master’s degree in Computer Science, Mathematics, Statistics.
4+ years of experience in writing scripts on Python
5+ Years of complex SQL / PL SQL development experience
3+ years of experience in ETL / Data warehousing project
Experience working in Agile framework
Good to have working experience on AWS or Snowflake