Jobs / Perplexity
Member of Technical Staff (Site Reliability Engineer, Search Crawler)
Perplexity · London, ENG, United Kingdom
London, ENG, United KingdomExp: 5+ yrsOnsite
Remuneration
Not specified
Location
London, ENG, United Kingdom
Visa sponsorship
Not specified
Job summary
Improve the throughput, capacity, and reliability of crawler services, including fetching and rendering fleets. The role operates Kubernetes workloads, builds infrastructure as code and CI/CD pipelines, defines SLOs and observability, and leads incident response. It also develops production software for automated diagnosis and remediation, using technologies such as Python, Go, Terraform, Datadog, Prometheus, and Grafana.
Qualifications
- At least five years of experience in SRE, production engineering, or infrastructure-heavy backend roles.
- Strong programming skills in Python, C++, Rust, or Go.
- Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
- Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.
- Experience building observability with Datadog, Prometheus, or Grafana and using SLOs to guide reliability improvements.
- Experience diagnosing distributed-system failures, leading production incidents, and improving performance or resource efficiency.
- Experience operating web crawlers, search infrastructure, or browser fleets at scale is preferred.
- Experience with distributed queues, backpressure, workload isolation, or multi-region recovery is preferred.
Responsibilities
- Operate and optimize Kubernetes workloads and infrastructure for crawler fetching and rendering fleets.
- Build and maintain infrastructure as code and CI/CD pipelines with safe rollouts, validation, and rapid rollback.
- Define SLOs and implement monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
- Plan capacity, improve resource efficiency, and diagnose queue backlogs, network failures, and resource bottlenecks.
- Participate in on-call rotations, lead incident response, and implement reliability improvements from blameless postmortems.
- Develop production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Skills
C++DatadogGoGrafanaKubernetesLinuxPrometheusPythonRustTerraform
Languages
PythonC++RustGo
Work schedule
On-call rotation
Industry
Web crawlingSearch infrastructure
Relocation
No