- Responsible for ETL development for assigned projects.
- Responsible for timely project deliverables.
- Responsible for writing ETL design documents.
- Collaborates with development teams, business units to identify, define, develop and implement new data source feeds.
- Monitors usage of the Data Warehouse to identify potential capacity overloads and bottlenecks.
- Assists with the tuning of ETL processes and database performance.
- Provides support for technical issues and ensuring system availability.
- Remains current on Enterprise Data Warehousing technologies, testing industry trends and best practices
- Provides guidance to more junior staff
- Well-versed with project management methodology for SDLC.
- Additional responsibilities may be assigned
Qualifications: To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Required skills and abilities:
- Self-starter with a "can-do" attitude, a must in a fast-paced business and technical environment
- Professional oral and written communication skills communicate regularly and effectively with other team members.
- Strong interpersonal and relationship-building skills, conducive to team development, work under own initiative. Ability to prioritize tasks and work concurrently on multiple tasks.
Education and/or Experience:
- Bachelor’s degree preferred.
- A broad understanding of general business and management practices is preferred.
- Complete understanding of all phases of the software development life cycle.
- Expert Knowledge of application design principles, systems development, and analysis.
- Complete understanding of relational database design and architecture
Technical Skills:
Informatica
- Advanced Informatica design and development skills using Informatica power center and power exchange (10.1+ preferred)
- 5+ years of experience in developing Informatica PowerCenter ETL mappings using Designer, Workflow Manager, Workflow Monitor, and Repository Manager
- Experience using parameter files, parameters/variables, and troubleshooting using advanced Informatica techniques like session partitioning, push down optimization, etc.
Oracle
- 5+ years of experience in PL/SQL
- 5+ years of experience in writing advanced queries for analysis and troubleshooting as needed.
- Must be well versed with database concepts like indexing, partitioning, performance tuning, explain plans, materialized views
Unix (Sun Solaris or Linux)
- 3+ years of experience writing shell scripts.
- Expertise in running jobs using various schedulers.
- Must be well versed with all Unix commands needed for running ETL jobs as well as for troubleshooting source and target files.
Datawarehousing
- 5+ years’ experience with data warehouse solution designs supporting data stores such as ODS, EDW, and DataMart
- 5+ years of experience with the design of large scale ETL solutions integrating internal and external data sources
- 5+ years of experience creating design documents like High Level and Low-Level design documents.
- Experience troubleshooting and resolving issues related to ETL applications, ETL system performance, and data integrity.
- Experience with ETL design review, code review, and quality assurance review process and deliverables.
- Experience in designing audit solutions.
- Experience with data analysis to identify data issues.
- Experience in working with onsite/offshore models.
Preferred Skills:
- Experience in working in Big Data (Hadoop, MapReduce, etc.) environment
- Experience with NoSQL databases like Cassandra, MongoDB, HBase, etc.
- Experience in working Data Lake using Amazon Elastic MapReduce (EMR).
- Experience working with Hive database and Hive tables.
TECHNICAL SKILLS
Must Have:
- Amazon Elastic MapReduce (EMR)
- Big Data
- Cassandra
- Data Analysis
- Database Concepts
- DataMart
- Data Warehousing > EDW
- EDW
- ETL
- ETL deployment and administration
- Hadoop
- HBase
- Hive Database
- Hive Tables
- Informatica
- Informatica Analytics Package > Informatica PowerCenter
- Informatica Analytics Package > Informatica PowerExchange
- MapReduce
- MongoDB
- NoSQL
- ODS
- Oracle
- UNIX/Shell Scripting
Nice To Have:
- Experience in designing audit solutions
- Experience in working with onsite/offshore model
- Experience with data analysis to identify data issues
- Shell scripting