Required Skills

Scala spark combination

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 28th Feb 2025

JOB DETAIL

Responsibilities: Design, develop, and maintain scalable data pipelines using Spark and Scala.

Implement ETL processes to transform and load data into Snowflake and other data warehouses.

Develop and optimize Hive queries for efficient data extraction and transformation.

Collaborate with data scientists and business analysts to ensure data quality and consistency.

Build and maintain data models and ETL processes to support business intelligence and reporting tools.

Monitor and troubleshoot data pipelines to ensure high availability and performance.

Implement Python scripts for data processing and automation tasks.

Stay up-to-date with the latest trends and technologies in data engineering and propose improvements. 5+ years of experience as a Data Engineer or similar role.

Proficiency in Spark, Scala, Hive, Python, and Snowflake. Strong understanding of ETL processes and data warehousing concepts.

Experience with SQL and NoSQL databases

Company Information