Required Skills

hive spark oozie airflow sqoop hadoop

Work Authorization

  • Citizen

Preferred Employment

  • Full Time

Employment Type

  • Direct Hire

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 23rd Nov 2022

JOB DETAIL

Roles and Responsibilities

 

Senior Data Engineer
5+ years of Bachelor's or Master's degree with hands on experience in building data engineering pipelines in a distributed environment
Good understanding of Data warehousing principles
Expertise in working with Big Data Technologies like Hadoop ,Hive, Spark(Scala/Java/Python), Sqoop, Oozie/Airflow
Good exposure to writing complex SQL ,shell scripting
Exposure to streaming data pipelines using Spark, Kafka
Exposure to Performance optimization of batch pipelines written in Hive/Spark
Experience on CI/CD (Continuous Integration/Delivery) i.e. Jenkins, GIT/BitBucket
Familiarity with working in an agile software development framework

Desired Candidate Profile


 

Perks and Benefits

Company Information