Clera

Research Engineer, Benchmarks

Singapore
Salary
$100K - $170K
Level
Mid
Work type
On-site · Singapore
Visa
Sponsors visas

Open. First seen 18 November 2026.

About the role

About the Role

Join a small, technical team building benchmarks to evaluate frontier AI agents on realistic, domain-specific workflows. You will own evaluation design and implementation, helping ensure benchmark results are rigorous, credible, and relevant to real-world performance.

What You'll Do

  • Design, implement, and maintain benchmarks for evaluating frontier agents on domain-specific tasks.
  • Work with subject-matter experts to translate real workflows into realistic tasks and evaluation criteria.
  • Build reliable infrastructure for running models and agents against benchmark tasks at scale.
  • Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.
  • Validate whether benchmark results correlate with real-world evaluations and user needs.
  • Write clear documentation and reports for technical audiences.

What We're Looking For

  • Two or more years of experience in research engineering or machine learning engineering, building AI benchmarks, evaluation infrastructure, or agent environments.
  • Technical education or equivalent grounding, with strong first-principles reasoning about task design, scoring, and failure modes.
  • Proficiency in Python, Docker, and Linux, including experience operating infrastructure for AI models or agents.
  • Hands-on experience designing and running evaluations for AI agents or large language models, with relevant, focused experience in benchmarks or evaluation.
  • Experience developing metrics, statistical analyses, or validation studies, and translating workflows across domains into benchmark tasks.
  • Strong technical writing and communication skills. Published papers or technical writing on benchmarking, evaluation, or model failure modes are valued.
  • Experience with reinforcement learning pipelines, data generation, or agent evaluation is a plus.
  • Comfort working independently in an early-stage, fast-paced environment and navigating open-ended problems.

Compensation & Benefits

Base salary: $100,000 to $170,000 annually. Visa sponsorship is available.

Location

On-site in Singapore, Singapore.

What this role asks for

Particular to this role

Docker · Linux

Rare in Clera's other 192 open postings.

Standard for software engineering roles

Python

Common in software engineering postings at any company.

Compared with Clera's other open jobs.

The team: Engineering HIRES STEADILY

This role is one of 191 open in Engineering. 125 were posted in the last 30 days and the oldest in March: a team that hires all year rather than one being built.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

LLM (97 of 191), TypeScript (89 of 191), React (78 of 191), Python (72 of 191), Machine Learning (36 of 191), Supabase (36 of 191), PostgreSQL (33 of 191)

OTHER ROLES ON THIS TEAM

From the team and dates on Clera's own job board.

Posting history

Reposted 4 times since 3 October 2026: a posting for this role in Singapore was taken down and the role was posted again.

Similar jobs

More jobs like this

Is this your posting? Email [email protected] to have it removed.