Development skills with Unix shell scripts, Apache Hadoop, Pig, Apache Hive, Java/ J2EE
Scala
Spark
Overall Hadoop ecosystem- HDFS, MAPREDUCE, SQOOP
Agile development experience
We need someone who has significant hands-on experience building a Hadoop datamart using Hive or Impala interfaces and can clearly explain the technical design to us. Some experience with SQL performance tuning would also be helpful