Required Skills

Python

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 8th Jan 2024

JOB DETAIL

Skills:
• AWS to GCP Migration
• AWS Kinesis -> GCP Pub/Sub
• Kafka -> GCP Pub/Sub
• EMR - Spark Streaming -> GCP Dataproc (Spark Streaming)
• Java (must), Python
 
Bachelor's degree in Computer Science, Information Technology, or a related field; advanced degree preferred.
Ø  Proven experience (7+ years) as a Data Engineer with a strong emphasis on stream processing.
Ø  Extensive hands-on experience with GCP services, Pub/Sub, BigQuery Streaming and related technologies.
Ø  Proficiency in programming languages such as Python and Java .
Ø  Programming languages Pyspark & Java
Ø  Deep understanding of real-time data processing and event-driven architectures.
Ø  Familiarity with data orchestration tools GCP cloud composer.
Ø  GCP certification(s) is a strong advantage.
Ø  Strong communication skills to effectively interact with both technical and non-technical stakeholders.
Ø  Work closely with data architects and stakeholders to architect scalable and fault-tolerant stream processing solutions on GCP.
Ø  Develop, implement, and optimize real-time data processing workflows using GCP services such as Dataflow, Pub/Sub, and BigQuery Streaming.
Ø  Implement data transformation and enrichment processes on streaming data to make it ready for analysis.
Ø  Create and maintain comprehensive documentation for data processing workflows, ensuring easy knowledge transfer and compliance with data governance standards.
Ø  Provide technical leadership and mentorship to junior data engineers, fostering skill development and best practices.
Ø  Diagnose and resolve issues related to batch job processing, ensuring minimal downtime.

Company Information