True Talent Solutions Partners

Software Engineer, RL Environments

San Francisco
Salary
$260K - $290K
Level
Mid
Work type
On-site · San Francisco
Visa
Sponsors visas

Open. First seen 19 November 2026.

About the role

About the Role

Build datasets, evaluation rubrics, and infrastructure that help improve advanced AI models. You will work with research teams to run experiments, identify model failure modes, and turn training objectives into practical data and evaluation systems.

What You'll Do

  • Design data slices that reveal meaningful model failure modes across finance, code, and enterprise workflows.
  • Build and refine evaluation rubrics and reward signals for RLHF and RLVR pipelines.
  • Model annotator behavior and run experiments to improve model capabilities.
  • Develop quantitative measures of dataset quality, diversity, and impact on model alignment and capabilities.
  • Create and manage real-world and synthetic data pipelines.
  • Partner with AI research teams to translate training goals into concrete data and evaluation specifications.

What We're Looking For

  • One to four years of software engineering experience building reliable data pipelines, experimentation infrastructure, or evaluation systems.
  • Strong Python skills and experience shipping software and infrastructure.
  • Hands-on experience with LLM evaluations, model post-training, reward modeling, RLHF, RLVR, or related ML infrastructure.
  • Experience creating or evaluating datasets, including assessing quality, diversity, coverage, and downstream model performance.
  • Strong experimental judgment: able to form hypotheses, define metrics, design controlled experiments, and interpret noisy results.
  • Experience designing data collection strategies and evaluation rubrics for machine learning models.

Compensation & Benefits

Base salary: $260,000 to $290,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California.

What this role asks for

Standard for software engineering roles

Python

Common in software engineering postings at any company.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 107 open in Client Roles. 107 were posted in the last 30 days, including 5 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (59 of 107), LLM (34 of 107), TypeScript (32 of 107), React (29 of 107), Machine Learning (28 of 107), AWS (26 of 107), Kubernetes (20 of 107)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 5 times since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

See Software Engineer salaries in San Francisco →

Similar jobs

More jobs like this

Is this your posting? Email [email protected] to have it removed.