Required Skills

Data Engineer

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 27th Aug 2021

JOB DETAIL

•             10+ years of experience in data engineering and data warehousing,

•             Minimum of 3 years of strong Spark experience.

•             Experience in migrating data from Hadoop to Spark is highly desired.

•             Should have a good understanding of a broad set of data/analytics platforms/technologies.

•             Should have led or been a key member of at least 4-5 end to end enterprise data management projects involving one or more of the following: big data, DWH, ETL, data streaming, data profiling or similar.

•             Need strong data engineering/ETL development experience with strong SQL expertise and experience with PySpark/Python.

•             Experience with cloud data ecosystem tools is desired (Core Java, SQL, Scala, PySpark, Impala, Hive, Hue, Hadoop, SparkSQL, Kafka etc.).

•             Experience in one or more public cloud platforms is highly desired (AWS, Azure, GCP, Cloudera etc.).

•             Experience in developing Spark jobs using Scala for processing large volumes of data.

•             Sound knowledge and experience of agile methodologies and practices.

•             Need expert level resources who can work independently with little supervision and guidance.

•             Should be able to lead, mentor and support junior team members including task assignment, deliverable review and corrective advice.

•             Need to be proactive communicators with an ability to articulate ideas and provide updates to senior client stakeholders.

 

Company Information