Required Skills

Spark Kafka

Work Authorization

  • US Citizen

  • Green Card

  • EAD (OPT/CPT/GC/H4)

  • H1B Work Permit

Preferred Employment

  • Corp-Corp

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 16th Aug 2022

JOB DETAIL

4+ years work experience as a Python Data Engineer or similar role

- 2+ years of hands-on development experience in Azure Data bricks

-2 years experience with Spark

- Previous experience with the Snowflake database management system

- Experience with big data tools: Hadoop, Spark, Kafka, etc.

- Experience with stream-processing systems: Storm, Spark-Streaming, etc.

- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.

- Strong analytic skills related to working with unstructured datasets.

- Build processes supporting data transformation, data structures, metadata, dependency and workload management.

- Hands-on implementation experience in manipulating, processing and extracting value from large disconnected datasets.

- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

- Strong engineer with ability to abstract our core/repeated requirements into a build-once, configurable framework.

Company Information