Required Skills

Big Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 8th Aug 2023

JOB DETAIL

• Associates will be working in a scrum team, should have knowledge & experience of agile/scrum/safe culture, associate would need to deal with clients therefore, good communication is essential.

• Selected candidates will be responsible for developing full application & be able to test & deploy the code.

• Should have good knowledge on CI/CD pipeline, should be able to help & guide other team members.

• Hands-on experience in designing and creating high performing data ingestion pipelines using Spark-sql/Java, yarn and hosted in Big Data platforms.

• Must have hands-on experience in reading various format inputs, optimal partitioning, optimal executors, memory etc.

• Must have hands-on experience in creating and using UDFs, Data-frames, Datasets, transformation, Spark Json APIs, Transformation and Spark actions

• Experience in Hadoop file system, hive

 

Experience: 7+ years

 

Top 3 Must Haves:

1. Big Data

2. Java

3. Spark

 

Additional Required Skills:

Spring BootJ2EECore, Microservices, Spark-SQL, UDFs, Data-frames, Datasets, transformation, Spark Json APIs, Transformation and Spark actions, Hadoop file system, hive

 

Company Information