Client Technology division is looking for a platform developer to work on the Cloud team. Our team is looking for an experienced software engineer with a strong background in python, end-to-end code pipelines, and modern data pipelines.
Required Skills:
- Must understand how to integrate and deploy CICD pipelines
- Must have heavy python experience, SQL queries and commands
- Spark and Hadoop are musts, will have to have demonstratable experience using both
- Understands Data engineering
- Ideal candidate would come from a DevOps background
- Candidates must be able to speak to artifact repositories
- Code to production
- Python Data Application Development (Pandas, Numpy, Jupyter, Zeppelin)
- Gitlab Pipeline Development (will take GitHub but GitLab is what he really wants
- Git Branching Strategies
- Experience with Airflow, AWS Glue, Redshift, AWS S3 DataLake
- PLSQL experience
- Data Quality Scripting (Great Expectations, Selenium)
Preferred Tech/Experience (Not required, but moves the candidate to the top of the list):
- Github experience (would need to be a rockstar in all other areas)
- Would take azure, but is not top of his list (if they have azure experience, he will expect them to be a rockstar in other required areas)
Really wanting an Architect but doesn’t have the budget for it, platform architecture experience or equivalent moves the candidate to the top of the list