- 5+ years of experience with data engineering with emphasis on data analytics and reporting
- Expert level experience with Python which demonstrate:
-
- Proficiency authoring distributable packages
- Proficiency authoring and automating unit tests using tools such as tox and pytest, preferably within a CI pipeline
- Proficiency enforcing code-quality and formatting consistency using tools such as mypy, flake8, and black
- Expert level SQL abilities
- Experience developing with Spark, preferably leveraging AWS EMR managed service
- Experience with AWS data engineering services, resources and architecture
- Experience working with source-code management tools such as GitHub and Jenkins
- Knowledge of agile delivery methodologies– Scrum, SAFe, Extreme Programming
- Understanding of microservices architecture and REST APIs
- Ability to partner with business and technology team members, to understand business requirements and translate those into value-add technology solutions
Additional preferences are:
- Experience with SQLAlchemy
- Experience with Apache Kafka
- Experience developing API clients
- Python examples demonstrated in publicly visible source code repositories
- Experience developing solutions in Snowflake
- Experience with workload automation tools such as Airflow, Autosys.
- Knowledge of building solutions with data visualization and reporting tools (e.g. Tableau, Metabase)