Years of experience on each of the Technical must have skills: 5+
Any Certifications required: GCP Professional data engineer, but optional
What will this resource be doing? Development of Spark Scala program in GCP environment and loading and validating data into GCP storage and Big query tables.
What outcome or deliverables are expected at the end of this assignment? Spark programs checked in Git repository along with CI/CD pipelines built