Required Skills

MapR MapR DB StreamSets JSON XML CSV Spark Spark Python Scala Teradata DBMS

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 19th Nov 2020

JOB DETAIL

Responsibilities of the Big Data Engineer

Experience in MapR, MapR DB, StreamSets
• Demonstrable expertise with Python, Spark, and wrangling of various data formats - Parquet, CSV, XML, JSON

Data Engineering professional hands on work experience with a strong background in Python, Spark, Pyspark and Scala.
• Strong SQL knowledge and data analysis skills for data anomaly detection and data quality assurance, exposure to NoSQL implementation.
• Programming experience in Scala, Python, shell scripting and automation
• Hadoop Certification or Spark Certification
• Experience with modern workflow/orchestration tools
• Experience working with PostgreSQL, Teradata and/or other DBMS platforms
• Experience with BI tools such as Tableau or Qlik to create visualizations and dashboards for various data quality metrics
• Experience deploying Data Science Solutions in a MapR and/or Cloud (e.g. AWS) environment a plus.
• Exposure to Solr, ELK stack
• Work on sprint team in agile, rapid development and deployment environment.

Company Information