Required Skills

python spark aws hive data streaming bigdata kafka hadoop data lake sql

Work Authorization

  • Citizen

Preferred Employment

  • Full Time

Employment Type

  • Direct Hire

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 22nd Jun 2022

JOB DETAIL

Technical Skills: Spark, Python, Data streaming, Data lake, AWS, Hive, Big data, Hadoop, SQL

Must have played Senior roles or contributed to architecture of their project

Must have worked on AWS stack. They should have knowledge of Glue, Kinesis, Hadoop, Cloudera, Spark, Redshift etc

Must have capabilities of working with customer or interest in working directly with customer ( communication should be excellent )

Must have experience in Big data, Hadoop, Spark

Must have experience in data streaming

Must have experience in data lake

Familiarity with some ORM (Object Relational Mapper) libraries like sqlalchemy, mongoengine, etc.

Must have experience in any database (My SQL, postgress )

Must have experience in any No SQL database

Able to integrate multiple data sources and databases into one system Creating REST API and design

Proficient understanding of code versioning tools Git.

Understanding of accessibility and security compliance.

Knowledge of user authentication and authorization between multiple systems, servers, and environments

Understanding of fundamental design principles behind a scalable application

Understanding of the differences between multiple delivery platforms, such as mobile vs desktop, and optimizing output to match the specific platform

Able to create database schemas that represent and support business processes

Strong unit test and debugging skill

Proficient in data wrangling using pandas or pyspark.

Proficient knowledge of integration of sklearn and pyspark.

 

Company Information