Member of Technical Staff, Agents
- Salary
- $200,000 - $300,000 annually
- Level
- Staff
- Visa
- Not offered
Not stated in the posting: work type.
This posting has closed on 28 October 2026.
About the role
About the Role
This is a hands-on engineering role focused on building and improving autonomous AI agents that handle real executive work end to end, from scheduling and emails to phone calls and relationship management. You will sit at the core of a small, senior team and own the full loop: shipping agents, measuring their quality, and making improvement a repeatable science. The work matters because the agents run in production for real users who depend on them without checking.
What You'll Do
- Build agents that complete delegated executive tasks end to end, without human follow-up.
- Design and maintain evaluation frameworks and metrics so the team knows, with confidence, how often agents get things right.
- Expand the set of tasks agents can handle in tools executives already use, with evidence of readiness before launch.
- Turn production failures into proven, permanent fixes quickly.
- Own detection at scale using observability and eval tooling to surface known failure patterns and the long tail the team has not seen yet.
- Build self-recovery so agents stay on task when a tool or external service fails.
- Make agent improvement measurable: change one thing, run realistic end-to-end simulations, keep what works.
What We're Looking For
- 5 or more years in data science, machine learning, or analytics, with a focus on evaluation systems and quality measurement for production AI.
- Demonstrated experience designing evaluation methodologies: success criteria, dataset construction, metric selection, and distinguishing real signal from noise.
- Production-quality Python and SQL; comfortable in Django, React, and TypeScript when work crosses into those areas.
- Strong statistical and experimental design skills including sampling, variance, bias detection, and significance testing for non-deterministic systems.
- Experience with LLM-as-a-judge systems, model-based graders, and grader calibration.
- Ability to debug analytically across prompts, traces, model outputs, code, databases, and APIs to find the real cause of a failure.
- Experience building and running agentic systems with multi-step execution and tool use in production.
- Ground-truth data development experience including labeling guidelines, annotation quality control, and dataset maintenance.
- Strong CS or engineering fundamentals from a rigorous degree program.
- Track record of owning something end to end, shipping it to real users, and showing what changed because of it.
Compensation & Benefits
Salary range: $200,000 to $300,000 USD annually. Visa sponsorship is not available for this role.
Location
On-site in Palo Alto, California, United States.
Posting history
Reposted 3 times since 1 October 2026: a posting for this role in Palo Alto was taken down and the role was posted again.
- 15 November 2026 – open
- 8 November 2026 – closed 14 November 2026
- 31 October 2026 – closed 7 November 2026
- 23 October 2026 – closed 30 October 2026
- 10 October 2026 – closed 28 October 2026
- 3 October 2026 – closed 26 October 2026
- 1 October 2026 – closed 28 October 2026 (this posting)
Similar jobs
- Staff Software Engineer at Pangram Labs
Shares 6 skills: Django, React, TypeScript… · Staff level · same country - Senior Full Stack Engineer at VYNYL
Shares 6 skills: Django, TypeScript, Machine Learning… · same country - Senior Full Stack Engineer (AI Platform) at Protagonist
Shares 6 skills: Django, React, TypeScript… · same country - Staff Software Engineer, Product Experiences at Peregrine Technologies
Shares 5 skills: Django, React, TypeScript… · Staff level · same country - Sr Staff Frontend Software Engineer, AI Hub at Qualcomm
Shares 5 skills: Django, React, TypeScript… · Staff level · same country - Founding Backend / AI Engineer at Clera
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.