Tagcor

Data Pipeline Engineer

Design, implement, and manage data pipelines to handle data from diverse sources.
Ensure efficient data processing, routing, and delivery across various systems.
Work with large-scale data analytics platforms such as Splunk, the ELK stack, DataBricks, and Snowflake.
Utilize and manage data pipeline technologies including Cribl, Confluent/Kafka, Airflow, and Apache Ni-Fi.
Develop custom scripts and tools using Python, and other relevant programming languages.
Collaborate with data engineering, analytics, and observability teams to optimize data workflows and infrastructure.
Monitor and troubleshoot data pipelines to ensure reliability and performance.
Stay updated with the latest trends and best practices in data pipeline technologies and large-scale data analytics.
Provide guidance and mentorship to junior engineers and other team members.