US Citizen
Green Card
EAD (OPT/CPT/GC/H4)
H1B Work Permit
Corp-Corp
W2-Permanent
W2-Contract
Contract to Hire
Consulting/Contract
UG :- - Not Required
PG :- - Not Required
No of position :- ( 1 )
Post :- 8th Jan 2024
Skills:
• AWS to GCP Migration
• AWS Kinesis -> GCP Pub/Sub
• Kafka -> GCP Pub/Sub
• EMR - Spark Streaming -> GCP Dataproc (Spark Streaming)
• Java (must), Python
Bachelor's degree in Computer Science, Information Technology, or a related field; advanced degree preferred.
Ø Proven experience (7+ years) as a Data Engineer with a strong emphasis on stream processing.
Ø Extensive hands-on experience with GCP services, Pub/Sub, BigQuery Streaming and related technologies.
Ø Proficiency in programming languages such as Python and Java .
Ø Programming languages Pyspark & Java
Ø Deep understanding of real-time data processing and event-driven architectures.
Ø Familiarity with data orchestration tools GCP cloud composer.
Ø GCP certification(s) is a strong advantage.
Ø Strong communication skills to effectively interact with both technical and non-technical stakeholders.
Ø Work closely with data architects and stakeholders to architect scalable and fault-tolerant stream processing solutions on GCP.
Ø Develop, implement, and optimize real-time data processing workflows using GCP services such as Dataflow, Pub/Sub, and BigQuery Streaming.
Ø Implement data transformation and enrichment processes on streaming data to make it ready for analysis.
Ø Create and maintain comprehensive documentation for data processing workflows, ensuring easy knowledge transfer and compliance with data governance standards.
Ø Provide technical leadership and mentorship to junior data engineers, fostering skill development and best practices.
Ø Diagnose and resolve issues related to batch job processing, ensuring minimal downtime.