Bachelor's degree in Computer Science, Information Technology, or a related field; advanced degree preferred.
Proven experience (7+ years) as a Data Engineer with a strong emphasis on stream processing.
Extensive hands-on experience with GCP services, Pub/Sub, BigQuery Streaming and related technologies.
Proficiency in programming languages such as Python and Java .
Programming languages Pyspark & Java
Deep understanding of real-time data processing and event-driven architectures.
Familiarity with data orchestration tools GCP cloud composer.
GCP certification(s) is a strong advantage.
Strong communication skills to effectively interact with both technical and non-technical stakeholders.
Work closely with data architects and stakeholders to architect scalable and fault-tolerant stream processing solutions on GCP.
Develop, implement, and optimize real-time data processing workflows using GCP services such as Dataflow, Pub/Sub, and BigQuery Streaming.
Implement data transformation and enrichment processes on streaming data to make it ready for analysis.
Create and maintain comprehensive documentation for data processing workflows, ensuring easy knowledge transfer and compliance with data governance standards.
Provide technical leadership and mentorship to junior data engineers, fostering skill development and best practices.
Diagnose and resolve issues related to batch job processing, ensuring minimal downtime.