- Minimum of 18+ Years of experience in IT and 4-5yrs experience in Big Data development and a hand-ons experience on performance tuning E2E data pipeline.
- Demonstrate issues faced in implementation and performance tuning experience in previous project and best practices following in performance implementations
- Create Scala/Spark jobs for data transformation and aggregation with a focus on the functional programming paradigm.
- Help in designing, building, and enhancing platform and ensure that developed components are testable, repeatable, highly performant, scalable, and automated.
- Write Scala doc-style documentation with all code & design data processing pipelines
- Batch interfaces and Real-time interfaces like Kafka messaging
- Good presentation and communication skills to express what is being worked on day-2-day activities
- Proficient in Java and Scala and C++, fixing/redesigning native libraries, knowledge of Python is a plus
- Prior experience or understanding on in-memory data storage and No-SQL DB like Redis, MongoDB & Cassandra
- Familiarity with Unix scripting & Automation
- Past experience in BigData development is preferable (Streaming on Apache Flink or Apache Spark) or else should be able to demonstrate conceptual differences between batch and streaming data processing
- Past experience in DataWarehouse/ETL/SQL development is preferable who can understand the E2E data flow or the application architecture
- Azure Integration and deployment experience would be a plus
- Quick learner who can come out with alternate options to solve an application problem
Expected Qualifications:
• BS or MS degree in Computer Science, Software Engineering, or related field
• Good written and verbal communication skills
• Orientation in modern standards and technical trends
• Orientation in surrounding frameworks and libraries, particularly Play
• Experience with microservices architectures, scalability, reliability, and fault tolerance
• Experience with continuous and iterative development
• Atlassian tools
• Experienced working in an Agile development environment, Continuous Integration and Delivery practices
• Cassandra / other No SQL databases experience & Reactive Systems
• Strong analytical and problem-solving skills and data-driven thinking