Member of Technical Staff (Answer Quality & Evals)
- Salary
- $200K - $350K
- Level
- Staff
- Work type
- Hybrid · San Francisco
Not stated in the posting: visa.
Open. First seen 9 September 2026.
About the role
Perplexity serves tens of millions of users daily with reliable, high-quality answers grounded in an LLM-first search engine and specialized data sources. The Answer Quality team ensures that our prompts, tools, search systems, datasets, and models work together to create the best possible experience for our users.
As our product and agent capabilities evolve, we need evaluation systems that are fast, reliable, production-faithful, and actionable. In this role, you will build and improve the technical foundations that support Answer Quality across Perplexity. This includes our shared evaluation infrastructure and the platform used to replay and analyze agent traces. You will work closely with data scientists, engineers, and product teams to identify quality problems, measure their impact, and turn evaluation findings into product improvements.
Responsibilities
- Build shared evaluation infrastructure that helps teams run reliable evals, analyze results, and make product and model decisions
- Develop the platform for replaying and analyzing agent traces to reproduce production behavior and diagnose failures
- Build and operate scalable systems for processing, storing, and monitoring interaction, trace, and evaluation data
- Partner with data scientists, engineers, and product teams to turn answer-quality problems into evaluations, analyses, and product improvements
- Operate in a small, high-impact team where your work directly shapes how Perplexity measures and improves Answer Quality
Qualifications
- 4+ years of software, data, or machine learning engineering experience shipping and operating production systems
- Strong proficiency in Python and SQL, with solid fundamentals in system design, data modeling, and distributed systems
- Experience building big-data systems, including distributed compute, large-scale storage, and high-volume pipelines
- Demonstrated ownership of ambiguous technical projects from initial design through production operation
- Ability to work effectively with data scientists, engineers, and product partners
Preferred Qualifications
- Experience building evaluation, experimentation, observability, or machine learning infrastructure
- Familiarity with LLM and agent systems, including tool use, execution traces, replay, and simulation
- Experience building on top of large-scale data processing platforms such as Databricks, Snowflake, or ClickHouse
What this role asks for
Particular to this role
ClickHouse · Databricks · SQL · Snowflake
Rare in Perplexity's other 95 open postings.
Compared with Perplexity's other open jobs.
The team: AI Research & Systems HIRES STEADILY
This role is one of 16 open in AI Research & Systems. 6 were posted in the last 30 days and the oldest in September: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Python (11 of 16), LLM (10 of 16), Machine Learning (8 of 16), Rust (6 of 16), Kubernetes (5 of 16), CUDA (4 of 16), Deep Learning (4 of 16)
OTHER ROLES ON THIS TEAM
- Member of Technical Staff (Perplexity Frontier Research) posted Nov 16
- Member of Technical Staff (AI Software Engineer, Agent Engine) posted Nov 15
- Engineering Manager (Agent Engine) posted Nov 9
- Member of Technical Staff (Software Engineer, AI Policy and Strategic Initiatives) posted Nov 7
- Member of Technical Staff (Secure Intelligence Institute) posted Oct 31
- Member of Technical Staff (Software Engineer, Training Infrastructure) posted Oct 31
- Member of Technical Staff (TPM, Inference) posted Sep 2
- Member of Technical Staff (AI Researcher) posted Aug 25
- Engineering Site Lead posted Aug 12
- Member of Technical Staff (Model Behavior) posted Jul 30
- Member of Technical Staff (ML Engineer, Recommendations & User Modeling) posted Jun 6
- Member of Technical Staff (AI Infrastructure Engineer) posted Apr 13
- Member of Technical Staff (AI Inference Engineer) posted Apr 13
- Member of Technical Staff (AI Inference Engineer) posted Apr 13
- Member of Technical Staff (Software Engineer, Applied AI) posted Sep 19
From the team and dates on Perplexity's own job board.
Similar jobs
- Data Products - Member of Technical Staff at Simile
Shares 4 skills: ClickHouse, LLM, SQL… · Staff level · same city - Principal Engineer & Technical Lead — .NET & Azure at Aperia
Shares 5 skills: ClickHouse, Databricks, LLM… · Staff level · same country - Staff Software Engineer, AI Platform & Infrastructure at Okta
Shares 4 skills: ClickHouse, Machine Learning, SQL… · Staff level · same city - Senior Director, EDA & HPC Engineering Platforms at Qualcomm
Shares 5 skills: ClickHouse, Databricks, Snowflake… · same country - Staff DevOps Engineer at Witness AI
Shares 4 skills: ClickHouse, LLM, SQL… · Staff level · same country - Member of Technical Staff (Index Engineer, Search Crawler) at Perplexity
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.