Data Engineers Primary Skills:
1) Everyone should have experience in:
One or both languages:
- Python
- Java
- SQL
- Data Engineer
- Agile
2) Extract Transform Load
3) Oracle DB
4) Big Data
5) Hadoop
6) For more senior candidates - System Architecture
Secondary Skills:
- Cloud Computing
- AWS Foundational Cloud Practitioner
- Databricks
- API
- CDT - Cloud Developer Toolkit
- Snowflake
Role Definition
- Leads the design, development, and support of complex Data Engineering projects.
- Consults with business unit management as needed to analyze requirements and identify the optimal technical solution to fit within existing technologies and comply with overall strategic direction.
- Ensures clear and concise expression of design decisions to development, business teams, and senior IT management.
- Proactively ensures minimum delays in systems deliverables, focuses on performance optimization for the total system.
- Provides subject matter expertise in addressing complex projects and issues that encompass a wide range of internal and external systems, components, and processes.
- Sets direction in evaluating and leveraging industry best practices.
- May participate in technical architecture reviews of current and prospective systems, and the establishment of corporate technology standards.
Relevant Experience
- BS degree in Computer Science or Engineering with strong problem solving and analytical background
- Proven track record of delivery of technically advanced solutions in support of multiple, simultaneous initiatives which span multiple disciplines and business lines
- Demonstrated experience working in an environment managing multiple, concurrent deliverables with shifting priorities, demands, and timelines
Minimum Skills Required
- Python – Advanced
- SQL – Advanced
- Hadoop / BigData – Advanced
- Cloud Computing – Intermediate
- REST – Intermediate Skills Preferred (but not required)
- Data Analysis – Intermediate
- System Architecture – Intermediate
- Snowflake (emerging technologies) – Foundational
- Azure (emerging technologies) – Foundational