Required Skills

Data Engineer

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

  • Contract to Hire

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 20th Mar 2024

JOB DETAIL

First Interview

•             Tell me about your current project.

•             How much data have you been dealing with in recent role? Have you had any challenges? How have you handled those challenges?

•             How familiar are you with different software architectures? Have you worked with microservices?

•             Do you have any experience with the Hadoop ecosystem?

•             How does Spark differ from MapReduce?

•             How do you ensure your Spark jobs are testable/maintainable?

•             What programming languages are you familiar with?

•             When you are approaching performance/scaling issues with large data sets, how do you optimize?

•             What orchestration tools have you used recently?

 

Second Interview

•             Tell me about your current project.

•             What is the difference between transformations and actions in Spark?

•             Do you have any experience with application security concerns?

•             Do you have any experience with Hadoop system and Hive?

•             Did you create UDFs in Hive? How?

•             Have you faced any problems with Oozie jobs?

•             Do you have any experience with Apache NiFi?

•             How much data are you used to work with?

•             Difference between RDD data frames and (I missed this part) in Spark?

 

Company Information