- Experience in consuming large data volume
- Advance SQL skills
- Optimize strategy process for data handling for aggregation tables (Minimize processing time for large data volume)
- Experience in data loading with complex model for data and batch orchestration
- Throughput understanding, monitoring for efficient data loading
- Identifying bottlenecks and resource investigation
- Experience in periodic ETL Code maintenance and setting up SLA for cross functional team
- Implementing necessary techniques to improve ETL performance in Both DB and Application
- Improving query performance by turning ad re-evaluating data model
- Identifying dependency impact on both data and Application
Duties and responsibilities
- Performance Analysis and documenting factors (bottleneck, memory handling and inefficiency area which needs improvement)
- Identifying and documenting execution Benchmarks and Metrics
- Optimization on application and database
- Validation techniques for data and Orchestration
- Documentation for Optimization and Operations
- Implementation Alert mechanism in case of potential impact to downstream
- Collecting and documenting the Metrics for each ETL application