• US Citizen

• Green Card

• Corp-Corp

• Consulting/Contract

• UG :- - Not Required

• PG :- - Not Required

• No of position :- ( 1 )

• Post :- 13th Aug 2022

Architect, design, and build Big Data applications to support business strategies and deliver business value

Hands-on experience in development, leading code reviews and testing, and working on proofs of concept using latest big data technologies

Advanced proficiency in SQL, data ingestion frameworks, data modeling, and working with big data

Mentor and inspire Junior team members

Willingness to learn new technologies constantly, and work/guide other team members

7+ years of overall IT experience

5+ years of experience as a Data Engineer or in a similar role

3+ years of experience with Big Data tools/technologies like Hadoop, Spark, Spark SQL, Kafka, Sqoop, Hive, S3, HDFS, or Cloud platforms e.g. AWS, Google Cloud Platform, etc.

3+ years of experience with high-velocity high-volume stream processing: Apache Kafka and Spark Streaming

Experience with real-time data processing and streaming techniques using Spark structured streaming and Kafka

Deep knowledge of troubleshooting and tuning Spark applications

3+ years of experience with data ingestion from Message Queues (Tibco, IBM, etc.) and different file formats across different platforms like JSON, XML, CSV

3+ years of experience building, testing, and optimizing ‘Big Data’ data ingestion pipelines, architectures, and data sets

2+ years of experience with Kudu and Impala

2+ years of experience with Scala (and/or Python) and PySpark/Scala-Spark

2+ years of experience with NoSQL databases, including HBASE and/or Cassandra

Knowledge of Unix/Linux platform and shell scripting is a must

Strong analytical and problem solving skills

Preferred (Not Required):

Experience with Cloudera/Hortonworks HDP and HDF platforms

Strong SQL skills with ability to write intermediate complexity queries

Experience with GIT code versioning software

Experience with REST API and Web Services

Good business analyst and requirements gathering/writing skills

Education

Bachelor’s Degree required. Preferably in Information Systems, Computer Science, Computer Information Systems or related field