- 6-9 Years of in data analytics, Apache Spark, Event streaming, batch file processing, data ingestion, modelling, NoSQL database and reporting
- Understanding of event streaming, data lineage and usage, data storage, modeling, and batch file processing
- Experience in developing highly available systems that utilize load balancing, horizontal scalability and high availability
- Experience (preferred) with large scale software development or application engineering with recent coding experience in Scala, Python or Java
- Experience with logging frameworks
Scope/Complexity of Work
- The Big Data Developer needs to passionately execute on high-quality deliverables as assigned. They will work collaboratively to ensure consistent and performant approaches for the entire user experience and analytic code developed inside the system They will interact directly with client project team members and operation staff to support live customer developments
- Contribute to Agile development methodology in terms of Sprint Planning
- Contribute high quality code and participate in code review and Sprint Demos.
- Implement stories and use-cases and keep task tracking updated.
Required Knowledge/Skills/Abilities:
- Experience developing scalable data platform leveraging HDFS, Hive, Spark, Kafka using Java, Python, or Scala dealing with real-time streaming data, batch data and analytics
- Design and enhance features on all pieces of the platform
- Applying standards, process, and architectural improvements