Clera

Research Engineer, Benchmarks

Singapore
Salary
$100,000 - $170,000 annually
Level
Mid
Work type
On-site · Singapore
Visa
Sponsors visas

Open. First seen 5 November 2026.

Apply on the company's site →

About the role

About the Role

Join a small, technical team at an early-stage AI evaluation company building benchmarks for frontier AI agents. You will own the design and implementation of rigorous, domain-specific evaluations that help research teams and customers understand real-world agent performance.

What You'll Do

  • Design, implement, and maintain benchmarks for evaluating AI agents on domain-specific tasks.
  • Work with subject-matter experts to translate real workflows into realistic tasks and evaluation criteria.
  • Build reliable infrastructure for running models and agents against benchmark tasks at scale.
  • Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.
  • Validate how benchmark results relate to real-world evaluations and user needs.
  • Write clear technical documentation and reports communicating benchmark methods and results.

What We're Looking For

  • Two to four years of experience in research engineering, machine learning engineering, or a related technical role, including at least two years building or delivering AI benchmarks, evaluation infrastructure, or agent environments.
  • Strong proficiency in Python, Docker, and Linux for research or production infrastructure.
  • Hands-on experience designing, implementing, and operating evaluations for AI agents or large language models.
  • Experience building infrastructure to run models or agents reliably, and developing metrics, statistical analyses, or validation studies.
  • Ability to collaborate with subject-matter experts and analyze workflows across different domains to create useful evaluation tasks.
  • Strong technical writing, attention to detail, first-principles reasoning, and comfort working independently in a fast-paced startup.
  • Published research or technical writing on benchmarking, model evaluation, or failure modes is valued. Reinforcement learning pipelines, data generation, and agent evaluation experience are also relevant.

Compensation & Benefits

Base salary: $100,000 to $170,000 USD annually. Visa sponsorship is available.

Location

On-site in Singapore, Singapore.

What this role asks for

Particular to this role

Docker · Linux

Rare in Clera's other 183 open postings.

Standard for software engineering roles

Python

Common in software engineering postings at any company.

Compared with Clera's other open jobs.

The team: Engineering HIRES STEADILY

This role is one of 182 open in Engineering. 116 were posted in the last 30 days and the oldest in March: a team that hires all year rather than one being built.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

LLM (92 of 182), TypeScript (91 of 182), Python (76 of 182), React (76 of 182), Machine Learning (42 of 182), PostgreSQL (36 of 182), Supabase (36 of 182)

OTHER ROLES ON THIS TEAM

From the team and dates on Clera's own job board.

Posting history

Reposted 2 times since 3 October 2026: a posting for this role in Singapore was taken down and the role was posted again.

Similar jobs

More jobs like this

SKILLSPython 47,771Machine Learning 20,165LLM 18,885Linux 12,832
PLACESSingapore 3,238
COMPANYJobs at Clera 184

Is this your posting? Email info@careerholo.com to have it removed.