Required Skills

Big Data Engineer Big Data; ETL - Big Data / Data Warehousing; PySpark; Spark; Hive

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 22nd Dec 2025

JOB DETAIL

  • Bachelor's degree in Engineering or Computer Science or equivalent OR Master’s in Computer Applications or equivalent.
  • 6+ years of software development experience and leading teams of engineers and scrum teams
  • 3+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark)
  • Solid Datawarehousing concepts
  • Knowledge of Financial reporting ecosystem will be a plus
  • Expert on Distributed ecosystem
  • Hands-on experience with programming using Core Java or Python/
  • Expert on Hadoop and Spark Architecture and its working principle
  • Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data
  • Experience in UNIX shell scripting
  • Ability to design and develop optimized Data pipelines for batch and real time data processing
  • Should have experience in analysis, design, development, testing, and implementation of system applications
  • Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.

 

Preferred Qualifications:

  • Knowledge of cloud platforms like GCP/AWS, building Microservices and scalable solutions, will be an advantage
  • 3 + years of experience in designing and building solutions using Kafka streams or queues
  • Experience with GitHub/Bitbucket and leveraging CI/CD pipeline
  • Experience with NoSQL i.e., HBase, Couchbase, MongoDB is good to have
  • Excellent technical and analytical aptitude
  • Good communication skills
  • Excellent Project management skills.
  • Results driven

 

Company Information