Clera

Senior Software Engineer, Model Evaluation

San Francisco
Salary
$180K - $250K
Level
Senior
Work type
On-site · San Francisco
Visa
Not offered

Open. First seen 19 November 2026.

About the role

About the Role

Join an early-stage AI team building agents for manufacturing operations. You will create benchmarks and train models against real procurement and supply-chain workflows, helping ensure agents can handle customer-facing tasks reliably.

What You'll Do

  • Design and build evaluation suites for supplier sourcing, qualification, compliance documents, purchase orders, freight, and order tracking.
  • Work with procurement and manufacturing experts to scope tasks, write reference answers and rubrics, and build graders.
  • Train and fine-tune models, using evaluation results to guide experiments.
  • Identify agent failures, improve production systems, and measure whether changes work.
  • Help establish the team's research and evaluation practices.

What We're Looking For

  • At least 3 years of experience, operating at a senior or staff level.
  • Hands-on experience designing benchmarks and evaluations, including authoring tasks, reference solutions or rubrics, and quality checks.
  • Practical experience training and fine-tuning models, not only using models through APIs.
  • Ability to work closely with non-ML domain experts and translate their knowledge into measurable tasks.
  • Supply-chain, procurement, manufacturing, or early-stage startup experience is helpful.

Compensation & Benefits

Base salary is $180,000 to $250,000 annually, plus equity. Visa sponsorship details were not provided.

Location

Hybrid in San Francisco, California, United States.

The team: Engineering HIRES STEADILY

This role is one of 193 open in Engineering. 127 were posted in the last 30 days and the oldest in March: a team that hires all year rather than one being built.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

LLM (93 of 193), TypeScript (83 of 193), Python (73 of 193), React (72 of 193), Machine Learning (37 of 193), Supabase (37 of 193), JavaScript (32 of 193)

OTHER ROLES ON THIS TEAM

From the team and dates on Clera's own job board.

See Software Engineer salaries in San Francisco →

Similar jobs

More jobs like this

Is this your posting? Email [email protected] to have it removed.