Staff Site Reliability Engineer - Splunk

Job summary

Okt*** is seeking a highly technical Staff Observability Site Reliability Engineer with a specialty in Splunk to enhance their Splunk ecosystem. The role involves designing scalable observability infrastructure, optimizing log data processing, and automating deployment across distributed systems.

Qualifications

• Minimum 5+ years of experience scaling and managing Splunk Cloud at scale (1000+ SVCs).
• Expertise in creating actionable Splunk dashboards that correlate data across multiple sources.
• Minimum 5+ years in an SRE, DevOps, or Systems Engineering role focused on high-availability systems.
• Strong coding skills in SPL and Go for building internal tools and automating workflows.
• Deep understanding of Linux internals, networking (TCP/IP, DNS, Load Balancing), and container orchestration (Kubernetes/EKS).
• Data-driven approach to debugging complex, cross-service performance bottlenecks.

Responsibilities

• Design, build, and maintain scalable observability infrastructure using tools like Terraform.
• Optimize the collection, processing, and storage of log data to ensure high reliability and low latency of Splunk services.
• Participate in on-call rotations and lead post-incident reviews to drive systemic improvements.
• Automate the deployment and scaling of observability agents and collectors.

Skills

Relocation