Understand Continuous Integration (CI) and Delivery (CD) concepts, and capabilities to support automation, pipelines, virtualization, and containerization
Fluency in one or more languages like Scala, Java, Python etc.
Understanding/experience in Apache Spark, Airflow, Databricks, AWS and related technologies
Nice to have:
Data engineer/SDET
Knowledge of Microservices and scaling techniques
Experience using web service APIs
Ability to create good acceptance and integration test automation scripts and integrate with Continuous integration (Jenkins/Bamboo) and code coverage tools (Sonar) to ensure 80% or higher code coverage