Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 12th Dec 2023

JOB DETAIL

  • Design, develop, and maintain scalable data pipelines using GCP Dataflow and Apache Airflow.
  • Implement data workflows and orchestration using GCP Composer.
  • Utilize GCP Dataproc for efficient processing of large-scale data sets.
  • Optimize and tune BigQuery queries for maximum performance.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
  • Ensure data quality, integrity, and reliability throughout the data pipeline.
  • Stay up-to-date with the latest advancements in GCP and data engineering technologies.

 

Qualifications:

  • Minimum of 6-7 years of experience in data engineering.
  • Strong proficiency in Python; experience in Java is a plus.
  • Extensive experience with GCP Dataflow, Apache Airflow, GCP Composer, GCP Dataproc, and BigQuery.
  • Solid understanding of SQL and its application in data engineering.
  • Hands-on experience in Google Cloud Platform

Company Information