Job Title : Hadoop Hive Lead
Location : Blue Bell, PA/ Hartford, CT
Duration : 12+ months
Job Description:
Roles/Responsibilities
Spark, Scala, Oracle
- Good understanding of Hadoop eco system, Yarn architecture
- Writing high performance Hive queries
- Good experience in Unix and shell scripting
- Hands on experience in Spark with Python, Scala
- Hands on with loading and manipulating large data sets using Spark
- SQL ,Hive knowledge on debugging and troubleshooting Hadoop jobs
- Prepare implementation plan as per the need and build the in scope applications in Big Data technologies
- Responsible for all technical deliveries of the project
- Manage data related requests, analyze issues and provide efficient resolution. Design all program specifications and perform required tests.
- Prepare codes for all modules according to require specification.
- Monitor all production issues and inquiries and provide efficient resolution.
- Evaluate all functional requirements and map documents and perform troubleshoot on all development processes.
- Collaborate with application groups to prepare effective solutions for all programs.
- Documents all technical specifications and associate project deliverables.
- Design all test cases to provide support to all systems and perform unit tests.
- Good understanding of Agile, DevOps methodology
- Good communication and client interfacing skill
- Should have worked in offshore delivery model
Required Qualifications
- Must have 7+ years of experience with Hadoop ecosystem HDFS Hive Sqoop and SPARK
- Bachelor’s Degree in Computer Science, Engineering or other STEM programs preferred
- Should have experience in developing framework and ETL process using HIVE SCALA Spark
- Experience in designing building and managing datamarts like processing in HIVE Spark
- Experience in Python programming
- Good experience in Unix and shell scripting
- Excellent analytical and technical skills with experience working in onsite, offshore model
Mohit Verma
Smart IT Frame - An Everify Employer
220 Davidson Ave, Suite #313, Somerset, NJ 08873
Direct:- 732-992-3172|| (Fax) 201-987-7575
Mohit@smartitframe.com | www.smartitframe.com