True Talent Solutions Partners

Member of Technical Staff

San Francisco
Salary
$200,000 - $300,000 annually
Level
Staff
Work type
On-site · San Francisco
Visa
Sponsors visas

Open. First seen 5 November 2026.

Apply on the company's site →

About the role

About the Role

Join a small AI infrastructure team building efficient inference for open-source language models. You will improve performance and reliability across diverse hardware, helping make production AI faster and more cost-effective.

What You'll Do

  • Deliver day-zero support for new open-source models, tuning them for latency and throughput.
  • Optimize inference serving through batching, KV cache management, speculative decoding, and quantization.
  • Write and tune kernels using CUDA, HIP, and Triton across a range of accelerator platforms.
  • Design, deploy, and operate heterogeneous clusters across hardware vendors.
  • Run production inference systems, improving reliability, observability, and cost per token.
  • Work with customers and teammates to identify problems and shape technical solutions.

What We're Looking For

  • Typically 1 to 6 years of experience in backend, infrastructure, systems, or related engineering work, including early-career candidates with strong internships.
  • Strong computer science fundamentals, including computer architecture, memory hierarchy, and operating system internals.
  • Systems engineering experience beyond application-level or web development, with ownership of challenging technical work.
  • Familiarity with CUDA, Triton, GPU programming, or comparable low-level systems technologies; experience with HIP is useful.
  • Experience with infrastructure at scale, such as clusters, data centers, or large GPU fleets, and familiarity with inference optimization techniques.
  • Comfort using AI coding tools to improve engineering workflows and communicating directly with customers.
  • Available to start immediately and work on-site in San Francisco.

Compensation & Benefits

Base salary is $200,000 to $300,000 annually. Visa sponsorship is available.

Location

On-site, five days per week in San Francisco, California.

What this role asks for

Particular to this role

CUDA

Rare in True Talent Solutions Partners's other 124 open postings.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 125 open in Client Roles. 125 were posted in the last 30 days, including 7 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (66 of 125), LLM (50 of 125), TypeScript (44 of 125), React (39 of 125), Machine Learning (30 of 125), JavaScript (28 of 125), AWS (25 of 125)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 3 times since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

Salary context

37 other open postings titled Member of Technical Staff state a salary: median USD 175,000 to USD 300,000 a year.

Similar jobs

More jobs like this

SKILLSCUDA 1,035
PLACESSan Francisco 7,720United States 74,582
COMPANYJobs at True Talent Solutions Partners 125

Is this your posting? Email info@careerholo.com to have it removed.