True Talent Solutions Partners

Member of Technical Staff

San Francisco
Salary
$200,000 - $300,000 annually
Level
Staff
Work type
On-site · San Francisco
Visa
Sponsors visas

Open. First seen 6 November 2026.

Apply on the company's site →

About the role

About the Role

Join a small AI infrastructure team working to make model inference faster and more energy and cost efficient. You will optimize the systems that serve open-source language models across heterogeneous hardware, with ownership spanning kernel performance through production operations.

What You'll Do

  • Ship support for new open-source models, tuning them for latency and throughput.
  • Optimize inference serving with techniques such as batching, KV caching, speculative decoding, and quantization.
  • Write and tune GPU kernels using CUDA, HIP, and Triton for a range of accelerator platforms.
  • Design, deploy, and operate heterogeneous clusters across hardware vendors.
  • Run production inference systems, improving reliability, observability, and cost per token.
  • Work directly with customers as part of solving infrastructure and performance problems.

What We're Looking For

  • Typically 1 to 6 years of experience in backend, infrastructure, systems, or low-level engineering, including experience at scale or in a fast-moving startup.
  • Strong understanding of computer architecture, memory hierarchies, and operating system internals.
  • Experience with production infrastructure such as data centers, clusters, or large GPU fleets.
  • Familiarity with machine learning inference optimization, including quantization, batching, KV caching, or speculative decoding.
  • Experience with CUDA, Triton, or other GPU programming, and familiarity with Python, HIP, or accelerator platforms such as TPU or AWS Trainium.
  • Evidence of strong technical ownership, rapid learning, or exceptional performance in demanding engineering work; strong computer science fundamentals are valued.
  • Comfort using AI agents and coding tools to improve engineering workflows, and communicating with customers.

Compensation & Benefits

Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California, five days per week.

What this role asks for

Particular to this role

CUDA

Rare in True Talent Solutions Partners's other 126 open postings.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 127 open in Client Roles. 127 were posted in the last 30 days, including 6 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (74 of 127), TypeScript (49 of 127), LLM (46 of 127), React (42 of 127), Machine Learning (38 of 127), AWS (32 of 127), JavaScript (27 of 127)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 4 times since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

Salary context

37 other open postings titled Member of Technical Staff state a salary: median USD 180,000 to USD 300,000 a year.

Similar jobs

More jobs like this

SKILLSPython 47,784AWS 26,942Machine Learning 20,161CUDA 1,042
PLACESSan Francisco 7,724United States 74,946
COMPANYJobs at True Talent Solutions Partners 127

Is this your posting? Email info@careerholo.com to have it removed.