Required Skills

Spark Developer

Work Authorization

  • US Citizen

  • Green Card

Preferred Employment

  • Corp-Corp

  • W2-Permanent

  • W2-Contract

Employment Type

  • Consulting/Contract

education qualification

  • UG :- - Not Required

  • PG :- - Not Required

Other Information

  • No of position :- ( 1 )

  • Post :- 26th Nov 2022

JOB DETAIL


• Working with application owners to understand business needs and create software solutions that meet the needs
• Working with other development teams to integrate new features into existing projects
• Designing, developing, testing, debugging, documenting, and supporting applications
• Coordinating with other team members throughout the development process to ensure that tasks are completed properly and on time
• Analyzing data sets to identify patterns and trends that can be used to improve existing products or develop new ones
• Following guidelines and standards for developing new applications or improving existing ones
• Designing and developing new software applications or improving existing ones
• Participating in design meetings with other members of the development team to discuss project details
• Work in a scrum team and participate in scrum ceremonies

Skills and Experience You Will Need:

• At least 4 years of experience in Scala and Spark (Batch and Structured Streaming) development
• Experience building data pipelines using both Spark structured streaming and spark batch processes.
• Experience in consuming and producing messages to Kafka topic
• Clear understanding of Hadoop Ecosystem & Spark Architecture
• Strong understanding of Functional programming and RESTful APIs
• Produce unit tests for Spark transformations and helper methods
• Experience with design and implementation of ETL framework for complex warehouses, Knowledge of large data sets and experience with performance tuning and troubleshooting.
• Strong knowledge and hands-on experience in SQL, Unix shell scripting

Company Information