Required Skills

Hadoop ecosystem Spark Python Hive Oozie Kafka PySpark Agile.

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 24th Nov 2020

JOB DETAIL

 PySPARK with AWS

The Big Data Developer will work on a collaborative Data Analytics team that is responsible for modernizing a retail analytics platform sitting on a Hadoop (Spark + Python) ecosystem. You will leverage your Hadoop ecosystem knowledge to design, and develop capabilities to deliver our solutions using Spark, Python, Hive, Oozie, Kafka, and other things in the Hadoop ecosystem.

Requirements for the Data Engineer / Spark Developer:

  • Familiarity with data management concepts -- data modeling, effectively organizing large data volumes; both structured and unstructured, data quality, data security, etc
  • Hands on experience with Spark / Python and PySpark in the Hadoop ecosystem.
  • Experience with relational data transformation to real-time data streaming.
  • A focus on Spark complementary tech like Spark SQL, RDD, PySpark and Sparkylr
  • Experience in working in Agile.

 Regards….!!!


Sachin Tyagi
Sr. Technical Recruiter || IDC Technologies, Inc.
Office: +1 408-457-9399 Ext: 3094
Cell: +91 999-934-3866
Email: sachin.t1@idctechnologies.com

Company Information