Tagcor

Hadoop Hive Kafka Impala HBase Spark-Python HiveQL big data implementation UNIX AVRO ORC files Paquet AWS ( Data frame. SQL queries

Strong experience in Big Data technologies like Hadoop, Hive using HiveQL, Spark-Python, HBase, Impala and Kafka
Develop comprehensive test strategy, test plan and test cases to test big data implementation
Test Automation preferably in scripting language Shell/Perl/Python on UNIX
Strong experience with SQL and unstructured and large volume data.
Knowledge of different data file formats such as AVRO, Paquet, ORC files
Working Experience on AWS (Red shift, S3, ) preferred
Pyspark for automation of Data frame.
Experience in writing complex SQL queries such as joins and aggregations to test data transformation logic