Required Skills

Data Engineer GCP

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 1st Sep 2022

JOB DETAIL

  • Designing and implementing Data Platforms, Data Pipeline(integration) technologies, and Common Data Services using cloud native integration and analytics technologies

  • Creating datasets for Machine learning algorithms and data analysis

  • Work closely and collaboratively with other members of the analytics teams to define requirements, mine and analyze data, integrate data from a variety of sources

  • Design and build low-code/no-code data pipeline frameworks to support large scale ingestions

  • Perform unit and integration testing

  • Perform detail assessments of current state data platforms and drive enhancements and optimization activities

  • Participate in implementation of BI visualizations

  • Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse, and moving data out to applications and affiliates

  • Provide mentoring to junior engineers

  • Optimize data pipelines for large scale data lake implementations

  • Implement Common Data Services (e.g., Data Orchestration using AirFlow, Data Governance capabilities using Collibra) to support reuse across business functions

Desired Qualifications:

Proven experience in the following:

  • Engineering experience in Big Data systems, Data Analytics and Data Integration related fields

  • GCP experience in Cloud Infrastructure, Data Integration, Data Engineering, Cloud Analytics solutions, and experience with operationalizing enterprise scale solutions

  • Architecting and designing data lakes on GCP cloud analytics, BI and Machine learning workloads

  • Middleware technologies, and Data Ingestion technologies like GCP DataFlow, Fusion, and AirFlow

  • Experience with AtScale is preferred

  • Writing complex SQL queries, stored procedures, etc.

  • Agile development skills.

  • CI/CD pipelines such as Concourse, Jenkins and Terraform technologies

Company Information