London, United Kingdom
Member of Technical Staff - Site Reliability Engineer - Crawler
Perplexity · London · United Kingdom
- Contract
- Full time
- Occupation
- DevOps / Platform Engineer
Posted: 13/11/2026 · Last checked: 16/11/2026
Job description
Quoted in full from Perplexity's job posting. Gavroche does not edit it.
Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.
Responsibilities
Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Qualifications
5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.
Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
Nice to have
Experience operating web crawlers, search infrastructure, or browser fleets at scale.
Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.
From Gavroche data
Figures computed from live adverts on Gavroche; the job text above is the employer's.
Similar roles in London
- Platform Engineer · Meticulous, London
- Staff Platform Engineer · Hyperexponential, London
- Senior Site Reliability Engineer · Encord, London
- Member of Technical Staff - Infrastructure Engineer - Training and Inference Systems · Inherent, London
- Member of Technical Staff - Infrastructure Engineer - Compute Infrastructure · Inherent, London
- Platform Engineer · Conduct, London
51 open roles like this one; at most three per employer shown.
How devops / platform engineer roles in the United Kingdom are worked
3% fully remote · 6% hybrid · 91% do not say
Of 36 adverts. An advert that does not state a work mode is counted as not saying, not as on-site.
New openings in London, by week
- 24/08/2026 289
- 31/08/2026 339
- 07/09/2026 391
- 14/09/2026 503
- 21/09/2026 504
- 28/09/2026 656
- 05/10/2026 710
- 12/10/2026 738
- 19/10/2026 695
- 26/10/2026 740
- 02/11/2026 764
- 09/11/2026 691
- 16/11/2026 93
7,113 openings over 12 weeks, by the week they were published.
Other roles at Perplexity
- Engineering Site Lead · London
- Internship - Search Machine Learning Engineer · London
- Member of Technical Staff - AI Inference Engineer · London
- Product Manager - Legal · San Francisco, United States
- Member of Technical Staff - TPM - Compute · San Francisco, United States
- Member of Technical Staff - Software Engineer - Data Platform · San Francisco, United States
61 open, including roles outside the United Kingdom.