This role will involve implementation of log data pipelines.
This is a net new position being added to the team (not a backfill).
Looking for candidates with Log Data Engineering experience.
Ability to process raw data from various sources. Experience writing scripts.
Experience using automation to ingest data - Ansible strongly preferred, but Terraform ok too.
Experience designing, developing, and deploying AWS cloud solutions.
A Splunk certification is preferred but NOT required.
Experience troubleshooting incidents.
*A Splunk Engineer or Splunk Developer w/ Automation experience would transition well to this role.
*What NOT to look for: Java Developer or someone doing Java programming/development work; or a DevOps Engineer focused mainly on CI/CD pipelines, etc.
Responsibilities
• Support systems engineering lifecycle activities for large hybrid Splunk and Cribl deployments, including requirements gathering, design, testing, implementation, operations, and documentation.
• Implementing log data pipelines through automation in Python to ingest logs into log management platforms like Splunk, Open Search
• Automating platform management processes through Ansible or other scripting tools/languages
• Troubleshooting incidents impacting the log data platforms
• Coordinating and collaboration with users of the platform
• Develop training and documentation materials
• Support log data platform upgrades including coordinating testing of upgrades with users of the platform
• Gather and process raw data from multiple disparate sources (including writing scripts, calling APIs, writing SQL queries, etc.) into a form suitable for analysis
• Enables log data, batch and real-time analytical processing solutions leveraging emerging technologies
• Build log data pipelines to help with the development and testing of log data engineering
Experience
General
• Ability to troubleshoot and diagnose complex issues
• Able to demonstrate experience supporting technical users and conduct requirements analysis
• Can work independently with minimal guidance & oversight
• Experience with IT Service Management and familiarity with Incident & Problem management
• Highly skilled in identifying performance bottlenecks, identifying anomalous system behavior, and resolving root cause of service issues.
• Demonstrated ability to effectively work across teams and functions to influence design, operations, and deployment of highly available software
• Knowledge of standard methodologies related to security, performance, and disaster recovery
Required Technical Expertise
• experience managing and configuring Splunk Enterprise and/or Splunk Cloud
• Developing and managing requirements, and making data-driven decisions
• Experience with Linux and Windows agents (Splunk, Fluentbit/Fluentd) for log data engineering
• Experience in designing, developing, and deploying cloud-based solutions using AWS
• Experience in onboarding new data, configuration, creating new dashboards, extracting information through Splunk, Cribl
• Experience in development of systems for data extraction, ingestion and processing of large volumes of data
• Demonstrated proficiency with scripting and automation (bash, python, other programming languages)
• Familiarity with Splunk rest API’s
• Knowledge of cloud platforms (prefer AWS) and container + orchestration technologies
• Experience with data pipeline orchestration platforms
Preferred Technical Experience
• Splunk Certification (Admin or Architect)
• Experience with Ansible tower automations
• Experience using Gitlab
• Experience with large platform migration efforts
• Experience with AWS OpenSearch
• Experience with Cribl
• Familiarity with data streaming technologies such as Kafka, Kinesis, spark streaming, etc.