True Talent Solutions Partners

Member of Technical Staff

San Francisco
Salary
$200K - $300K
Level
Staff
Work type
On-site · San Francisco
Visa
Sponsors visas

This posting has closed on 18 November 2026.

About the role

About the Role

Join a small AI infrastructure team building efficient inference systems for open-source language models. You will optimize models and serving infrastructure across diverse hardware, helping improve performance, reliability, and cost per token.

What You'll Do

  • Ship support for new open-source models, tuning them for latency and throughput.
  • Optimize inference serving with techniques such as batching, KV caching, speculative decoding, and quantization.
  • Write and tune kernels using CUDA, HIP, and Triton across a range of accelerator platforms.
  • Design, deploy, and operate heterogeneous clusters across infrastructure vendors.
  • Run production inference across a mixed hardware fleet, improving reliability, observability, and cost efficiency.
  • Work with customers to understand technical needs and solve infrastructure problems.

What We're Looking For

  • Typically 1 to 6 years of experience in backend, infrastructure, systems, or low-level engineering, including experience at a technology company or early-stage startup.
  • Strong computer science fundamentals, including computer architecture, memory hierarchy, and operating system internals.
  • Experience owning a challenging system end to end, notable technical achievements, or evidence of rapid growth.
  • Systems engineering experience beyond application-level or full-stack development, with a non-research-focused background.
  • Familiarity with CUDA, Triton, or GPU programming; experience with HIP, TPU, or AWS Trainium is also relevant.
  • Knowledge of inference optimization techniques, such as quantization, batching, KV caching, and speculative decoding.
  • Experience deploying or operating infrastructure at scale, such as clusters or GPU fleets.
  • Experience using AI agents and coding tools to improve engineering workflows, and comfort communicating with customers.
  • Strong internships or equivalent hands-on experience are welcome, including for recent graduates.

Compensation & Benefits

Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California, five days per week.

The team: Client Roles

This role is one of 128 open in Client Roles. 128 were posted in the last 30 days, including 7 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (69 of 128), TypeScript (44 of 128), React (39 of 128), LLM (38 of 128), Machine Learning (34 of 128), JavaScript (28 of 128), AWS (26 of 128)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 14 times since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

Salary context

38 other open postings titled Member of Technical Staff state a salary: median USD 180,000 to USD 300,000 a year.

Similar jobs

More jobs like this

Is this your posting? Email [email protected] to have it removed.