True Talent Solutions Partners

Member of Technical Staff

San Francisco
Salary
$200,000 - $300,000 annually
Level
Staff
Work type
On-site · San Francisco
Visa
Sponsors visas

Open. First seen 8 November 2026.

About the role

About the Role

Join a small AI infrastructure team building tools to improve the performance and efficiency of model inference across diverse hardware. This hands-on role spans low-level systems engineering, production operations, and customer collaboration.

What You'll Do

  • Bring new open-source models into production with support tuned for latency and throughput.
  • Improve the inference serving stack, including batching, KV caching, speculative decoding, and quantization.
  • Write and tune GPU kernels using CUDA, HIP, and Triton across a range of accelerator platforms.
  • Design, deploy, and operate heterogeneous clusters across infrastructure vendors.
  • Operate production inference systems, improving reliability, observability, and cost efficiency at scale.
  • Work with customers to understand performance needs and solve technical problems.

What We're Looking For

  • Typically 1 to 6 years of experience in backend, infrastructure, systems, or related engineering, with strong low-level engineering skills.
  • Strong understanding of computer architecture, memory hierarchy, and operating system internals.
  • Experience with CUDA, HIP, Triton, or other GPU programming, and familiarity with Python and accelerator platforms such as TPU or AWS Trainium.
  • Background deploying or operating large-scale infrastructure, clusters, or GPU fleets is valuable.
  • Familiarity with machine learning inference optimization techniques such as quantization, batching, KV caching, or speculative decoding is valuable.
  • Strong computer science fundamentals, a record of solving demanding technical problems, and experience using AI coding tools to improve workflows.
  • Comfort working directly with customers and contributing across a broad range of engineering challenges.

Compensation & Benefits

Base salary is $200,000 to $300,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California.

What this role asks for

Particular to this role

CUDA

Rare in True Talent Solutions Partners's other 129 open postings.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 130 open in Client Roles. 130 were posted in the last 30 days, including 5 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (68 of 130), LLM (45 of 130), TypeScript (39 of 130), React (37 of 130), Machine Learning (35 of 130), AWS (31 of 130), GCP (22 of 130)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 6 times since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

Salary context

37 other open postings titled Member of Technical Staff state a salary: median USD 180,000 to USD 300,000 a year.

Similar jobs

More jobs like this

Is this your posting? Email info@careerholo.com to have it removed.