Required Skills

DBT airflow pipeline data mining machine learning production support statistics data engineering Python Kafka Scala with Spark

Work Authorization

  • Us Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

Employment Type

  • Permanent Direct Hire

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 7th Nov 2020

JOB DETAIL

  • 10 years of recent hands on experience in data engineering and pipeline development.
  • Programming experience, ideally in Python, Scala with Spark, Kafka, and a willingness to learn new programming languages to meet goals and objectives.
  • Experience in distributed computing and MapReduce paradigm is a must.
  • Understanding Hadoop ecosystem components like HIVE is must.
  • Knowledge of data cleaning, wrangling, visualization and reporting using tools like Looker/Quilk.
  • Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.

GOOD TO HAVE

  • Use tools like DBT (data ) and workflows like airflow/Perfect for data transforms and pipeline is a plus.
  • Knowledge of data mining, machine learning, natural language processing, or information retrieval is a plus.
  • Experience in production support and troubleshooting is a plus.
  • Strong knowledge of and experience with statistics

Company Information