As a Senior Data Engineer, you will play a crucial role in designing and developing big data applications using cutting-edge open-source technologies. Key responsibilities include:
Designing and developing logical and physical data models for big data platforms.
Automating workflows using Apache Airflow.
Creating data pipelines using Apache Hive, Apache Spark, Scala, and Apache Kafka.
Providing ongoing maintenance and enhancements to existing systems, participating in rotational on-call support.
Learning the business domain and technology infrastructure quickly, actively sharing knowledge within the team.
Mentoring junior engineers.
Leading daily standups and design reviews.
Grooming and prioritizing backlog using JIRA.
Serving as the point of contact for the assigned business domain.