True Talent Solutions Partners

Full-Stack Engineer, Agent Evaluation & Reliability

San Francisco
Salary
$120K - $180K
Level
Mid
Work type
On-site · San Francisco
Visa
Sponsors visas

Open. First seen 15 November 2026.

About the role

About the Role

Join an AI team building infrastructure for agent evaluation and continuous improvement. This backend-leaning full-stack role combines ownership of core systems with the opportunity to ship product features and work directly with enterprise customers.

What You'll Do

  • Build backend systems and data models for evaluation datasets, experiment runs, agent traces, knowledge versions, findings, and customer-defined quality criteria.
  • Develop and support enterprise integrations, including authentication, OAuth, webhooks, incremental syncs, backfills, rate limits, retries, and monitoring.
  • Own features from technical design and implementation through deployment, monitoring, customer feedback, and iteration.
  • Work with customers to understand their systems, diagnose issues, and turn specific needs into reusable product capabilities.
  • Contribute across the stack, building product experiences that make underlying systems useful.

What We're Looking For

  • At least 2 years of experience building and shipping production systems as a backend or full-stack engineer.
  • Production experience with TypeScript and Node.js or Bun, PostgreSQL, and job queues or worker systems.
  • Experience at a fast-paced startup, and a track record of owning projects end-to-end from design through deployment and iteration.
  • Hands-on machine learning engineering experience, including model development.
  • Experience building enterprise integrations, including OAuth flows, webhooks, incremental syncs, backfills, and rate-limit handling.
  • Production experience with agent infrastructure, LLM evaluation, tracing, or agent memory systems is valuable.

Compensation & Benefits

Base salary: $120,000 to $180,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California, United States.

What this role asks for

Particular to this role

OAuth

Rare in True Talent Solutions Partners's other 126 open postings.

Standard for full stack roles

JavaScript · Node.js · PostgreSQL · TypeScript

Common in full stack postings at any company.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 128 open in Client Roles. 128 were posted in the last 30 days, including 7 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (69 of 128), TypeScript (44 of 128), React (39 of 128), LLM (38 of 128), Machine Learning (34 of 128), JavaScript (28 of 128), AWS (26 of 128)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 4 times since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

Similar jobs

More jobs like this

Is this your posting? Email [email protected] to have it removed.