True Talent Solutions Partners

Software Engineer, RL Environments

San Francisco
Salary
$260K - $290K
Level
Junior
Work type
On-site · San Francisco
Visa
Sponsors visas

This posting has closed on 18 November 2026.

About the role

About the Role

Join a Series A AI training data company building datasets and evaluation systems for frontier models. You will work with research teams to design experiments, identify model failure modes, and create data and metrics that inform model training.

What You'll Do

  • Design data slices across finance, software development, and enterprise workflows to reveal meaningful model failure modes.
  • Build and refine evaluation rubrics and reward signals for RLHF and RLVR pipelines.
  • Model annotator behavior and run experiments to improve model capabilities.
  • Develop quantitative frameworks to measure dataset quality, diversity, and downstream effects on model alignment and capability.
  • Create and manage real-world and synthetic data pipelines.
  • Partner with research teams to translate training objectives into concrete data and evaluation specifications.

What We're Looking For

  • 1 to 4 years of software engineering experience building reliable data pipelines, experimentation infrastructure, or evaluation systems.
  • Strong Python skills and experience shipping software and infrastructure.
  • Hands-on experience with LLM evaluations, model post-training, reward modeling, RLHF, RLVR, or related ML infrastructure.
  • Strong experimental judgment, including forming hypotheses, defining metrics, designing controlled experiments, and interpreting noisy results.
  • Experience creating or evaluating datasets, measuring quality, diversity, coverage, and downstream model performance.
  • Experience designing data collection strategies and evaluation rubrics for machine learning models.
  • Experience in AI safety, benchmarking, model evaluation, or research engineering is beneficial.

Compensation & Benefits

Base salary: $260,000 to $290,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California.

The team: Client Roles

This role is one of 107 open in Client Roles. 107 were posted in the last 30 days, including 5 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (59 of 107), LLM (34 of 107), TypeScript (32 of 107), React (29 of 107), Machine Learning (28 of 107), AWS (26 of 107), Kubernetes (20 of 107)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 5 times since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

See Software Engineer salaries in San Francisco →

Similar jobs

More jobs like this

Is this your posting? Email [email protected] to have it removed.