Required Skills

Data Engineer ETL

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 18th Mar 2024

JOB DETAIL

·         Expertise with the Technology stack available in the industry for data management, data ingestion, capture, processing and curation

·         ETL development experience with strong SQL background

·         Experience in building high-performing data processing frameworks leveraging Google Cloud Platform

·         Experience in building data pipelines supporting both batch and real-time streams to enable data collection, storage, processing, transformation and aggregation.

·         Experience in utilizing GCP Services like Big Query, Composer, Dataflow, Pub-Sub, Cloud Monitoring

·         Experience in performing ETL and data engineering work by leveraging multiple google cloud components using Dataflow, Data Proc, BigQuery

·         Experience in scheduling like Airflow, Cloud Composer etc.

·         Experience in JIRA or any other Project Management Tools

·         Experience in CI/CD automation pipeline facilitating automated deployment and testing

·         Experience in bash shell scripts, UNIX utilities & UNIX Commands

·         Nice to have Qualifications

·         Strong understanding towards Kubernetes, Docker containers and to deploy GCP services is a plus

·         Knowledge of Scrum/Agile development methodologies is a plus

·         Any experience with Spark, PySpark, or Kafka is a plus

·         Data analysis / Data mapping skills is a plus

·         Knowledge  in data manipulation JSON and XML

Company Information