Data Engineer is responsible for developing, monitoring, and maintaining/supporting dashboards, analytics, BI models, and data solutions that enables the business to make informed and timely decisions. Participates in all phases of the software development life cycle and ensures the delivery of quality Data product and BI Solutions according to system specifications, quality requirements and Company standards. In addition, works collaboratively with other team members and business analysist, actively participates in peer reviews, and contributes to process improvements.
PRIMARY DUTIES & RESPONSIBILITIES (Essential Functions of the Position) include but are not limited to the following. Other duties may be assigned.
- Develop business intelligence and data warehousing solutions to meet business needs.
- Work with Business analysts and BI team to develop data solution and documentation.
- Maintain, monitor and troubleshoot existing ETL jobs, BI models.
- Data profiling to understand source data grain, enhance or modify existing data model and build ETL jobs to enhance existing data warehouse.
- Build data pipelines and ETLs for loading source system data into the data warehouse for further reporting and analysis.
- Troubleshoot, fix and explain failures/errors in data or dashboards.
- Develop standard reports and dashboards based on business requirements.
- Adopting best practices in the implementation and execution of support processes
- Participate in scheduled Agile meetings
- Analyzes features and user requirements to create user stories, design specifications and provides effort estimation for development.
- Writes well designed, flawless, secure, testable, and efficient code.
- Develops unit-test code for robustness, including edge cases, usability, and general reliability.
- Ensures timely delivery in compliance with specifications and project plans.
QUALIFICATION GUIDELINES
Typical Knowledge, Skills, & Abilities:
- Working experience in building Data Marts and Data Modeling.
- Deep Experience and understanding of SQL (PL-SQL, Redshift, stored procedure).
- Experience with Power BI.
- Good understanding of Data warehouse, ETL, AWS architecture, Redshift, Step function, Lambda, Stored procedure
- Good understanding of DevOps.
- Strong analytical skills, problem solving mindset and out-of-the-box thinking.
- Strong communication and interpersonal skills with demonstrated collaborative teamwork capabilities.
- Exceptional problem-solving skills
- Self-motivated
- 3 + years of experience in AWS, Glue, Python, Spark, Redshift
- Experience in an Agile environment
- Excellent written and verbal communication skills
MINIMUM EDUCATION, EXPERIENCE OR CERTIFICATIONS
- Bachelor’s degree in Computer Science, Electrical Engineering, Computer Engineering or equivalent. Master’s degree preferred.
- 4-5 years of relevant work experience.
- Fluency in English language (both oral and written).