True Talent Solutions Partners

Member of Technical Staff

San Francisco
Salary
$200K - $300K
Level
Staff
Work type
On-site · San Francisco
Visa
Sponsors visas

Open. First seen 19 November 2026.

About the role

About the Role

Join a small AI infrastructure team working to improve the performance and energy efficiency of large language model inference. You will build and operate systems that serve open-source models across a range of hardware, with ownership spanning low-level optimization through production deployment.

What You'll Do

  • Deliver support for new open-source models, tuning them for latency and throughput.
  • Optimize inference serving, including batching, KV cache management, speculative decoding, and quantization.
  • Write and tune GPU kernels using CUDA, HIP, and Triton across heterogeneous hardware.
  • Design, deploy, and operate clusters spanning multiple hardware vendors.
  • Run production inference systems, improving reliability, observability, and cost per token.
  • Work with customers to understand needs and solve infrastructure challenges.

What We're Looking For

  • Typically 1 to 6 years of experience in backend, infrastructure, or systems engineering, including low-level work beyond application development.
  • Strong understanding of computer architecture, memory hierarchy, and operating system internals.
  • Experience with CUDA, Triton, or GPU programming; familiarity with HIP and heterogeneous accelerators is useful.
  • Knowledge of ML inference optimization, such as quantization, batching, KV caching, or speculative decoding.
  • Experience deploying or operating infrastructure at scale, such as clusters or large GPU fleets.
  • Strong computer science fundamentals and evidence of ownership, rapid learning, or accomplishment on challenging technical work.
  • Comfort using AI coding tools to improve engineering workflows and communicating with customers as part of the role.
  • Early-career candidates and new graduates with relevant internships are welcome.

Compensation & Benefits

Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California, five days per week.

What this role asks for

Particular to this role

CUDA

Rare in True Talent Solutions Partners's other 106 open postings.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 107 open in Client Roles. 107 were posted in the last 30 days, including 5 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (59 of 107), LLM (34 of 107), TypeScript (32 of 107), React (29 of 107), Machine Learning (28 of 107), AWS (26 of 107), Kubernetes (20 of 107)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 15 times since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

Salary context

37 other open postings titled Member of Technical Staff state a salary: median USD 175,000 to USD 300,000 a year.

Similar jobs

More jobs like this

Is this your posting? Email [email protected] to have it removed.