Member of Technical Staff (Site Reliability Engineer, Crawler)
- Level
- Staff
Not stated in the posting: salary, work type, visa.
Open. First seen 13 November 2026.
About the role
Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.
Responsibilities
- Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
- Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
- Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
- Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
- Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
- Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Qualifications
- 5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
- Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
- Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.
- Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
- Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
Nice to have
- Experience operating web crawlers, search infrastructure, or browser fleets at scale.
- Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.
What this role asks for
Particular to this role
C++ · Datadog · Grafana · Networking · Prometheus
Rare in Perplexity's other 95 open postings.
Standard for DevOps / SRE / cloud roles
CI/CD · Golang · Kubernetes · Linux · Python · Terraform
Common in DevOps / SRE / cloud postings at any company.
Compared with Perplexity's other open jobs.
The team: Search HIRES STEADILY
This role is one of 17 open in Search. 4 were posted in the last 30 days and the oldest in March: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Rust (12 of 17), C++ (9 of 17), Python (9 of 17), Golang (8 of 17), Kubernetes (7 of 17), LLM (7 of 17), AWS (6 of 17)
OTHER ROLES ON THIS TEAM
- Member of Technical Staff (Index Engineer, Search Crawler) posted Nov 17
- Member of Technical Staff (Web Access Engineer, Crawler) posted Nov 13
- Member of Technical Staff (Software Engineer, Fraud Prevention) posted Oct 23
- Member of Technical Staff (Search Crawler Analyst) posted Oct 8
- Member of Technical Staff (Machine Learning Engineer, Search Agent RL) posted Oct 6
- Member of Technical Staff (Search Core DevOps Engineer) posted Sep 25
- Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream) posted Sep 18
- Member of Technical Staff (Search Quality Analyst) posted Sep 2
- Member of Technical Staff (Machine Learning Engineer, Ranking Quality - Search) posted Aug 12
- Internship - Search Backend Infra Engineer posted Jul 1
- Internship - Search Machine Learning Engineer posted Apr 8
- Internship - Search Machine Learning Engineer posted Jan 13
- Member of Technical Staff (Backend Software Engineer, Search Crawler) posted Jul 28
- Member of Technical Staff (Search Engine Developer, Search Core) posted Mar 31
- Member of Technical Staff (Machine Learning Engineer, Search) posted Mar 25
- Member of Technical Staff (Backend/Infrastructure Engineer, Search) posted Mar 7
From the team and dates on Perplexity's own job board.
Similar jobs
- Site Reliability Engineer at LiveRamp
Shares 9 skills: Datadog, Prometheus, Grafana… · same city - Site Reliability Engineer, Mistral Cloud at Mistral
Shares 8 skills: Datadog, Prometheus, Grafana… - Site Reliability Engineer at neurohire.ai
Shares 10 skills: Datadog, Prometheus, Grafana… - Staff Site Reliability Engineer at Sprout Social
Shares 7 skills: Datadog, Grafana, Terraform… · Staff level - Staff Site Reliability Engineer at Nexxen
Shares 7 skills: Datadog, Prometheus, Grafana… · Staff level - Member of Technical Staff (Index Engineer, Search Crawler) at Perplexity
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.