← Back to all roles in the United Kingdom

London, United Kingdom

Member of Technical Staff - Site Reliability Engineer - Crawler

Perplexity · London · United Kingdom

Contract
Full time
Occupation
DevOps / Platform Engineer

Posted: 13/11/2026 · Last checked: 16/11/2026

Job description

Quoted in full from Perplexity's job posting. Gavroche does not edit it.

Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.

Responsibilities

  • Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.

  • Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.

  • Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.

  • Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.

  • Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.

  • Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.

Qualifications

  • 5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.

  • Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.

  • Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.

  • Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.

  • Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.

Nice to have

  • Experience operating web crawlers, search infrastructure, or browser fleets at scale.

  • Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.

From Gavroche data

Figures computed from live adverts on Gavroche; the job text above is the employer's.

Similar roles in London

51 open roles like this one; at most three per employer shown.

How devops / platform engineer roles in the United Kingdom are worked

3% fully remote · 6% hybrid · 91% do not say

Of 36 adverts. An advert that does not state a work mode is counted as not saying, not as on-site.

New openings in London, by week

  1. 24/08/2026 289
  2. 31/08/2026 339
  3. 07/09/2026 391
  4. 14/09/2026 503
  5. 21/09/2026 504
  6. 28/09/2026 656
  7. 05/10/2026 710
  8. 12/10/2026 738
  9. 19/10/2026 695
  10. 26/10/2026 740
  11. 02/11/2026 764
  12. 09/11/2026 691
  13. 16/11/2026 93

7,113 openings over 12 weeks, by the week they were published.

Other roles at Perplexity

61 open, including roles outside the United Kingdom.