True Talent Solutions Partners

Member of Technical Staff

San Francisco
Salary
$200K - $300K
Level
Staff
Work type
On-site · San Francisco
Visa
Sponsors visas

Open. First seen 18 November 2026.

About the role

About the Role

Join a small AI infrastructure team working to improve the performance and efficiency of large language model inference. You will contribute across software systems, GPU kernels, and production deployments, helping deliver fast, reliable inference across diverse hardware.

What You'll Do

  • Bring support for new open-source models to production, tuning them for latency and throughput.
  • Optimize inference serving, including batching, KV caching, speculative decoding, and quantization.
  • Write and tune GPU kernels using CUDA, HIP, and Triton across varied hardware platforms.
  • Design, deploy, and operate heterogeneous compute clusters.
  • Maintain production inference systems, with a focus on reliability, observability, and cost efficiency.
  • Work autonomously on technical problems and collaborate with customers and teammates to guide solutions.

What We're Looking For

  • One to six years of software engineering experience, including systems or low-level engineering close to hardware.
  • Strong understanding of computer architecture, memory hierarchy, and operating system internals.
  • Experience with backend, infrastructure, or systems work, as well as familiarity with Python and GPU programming tools such as CUDA or Triton.
  • Background in machine learning inference optimization or operating large-scale infrastructure, such as clusters or GPU fleets, is valuable.
  • Evidence of strong technical ownership, rapid learning, and effective problem-solving; customer-facing experience is also useful.
  • Uses AI agents or coding tools to improve engineering workflows.

Compensation & Benefits

Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.

Location

On-site in San Francisco, California, five days per week.

What this role asks for

Particular to this role

CUDA

Rare in True Talent Solutions Partners's other 126 open postings.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 128 open in Client Roles. 128 were posted in the last 30 days, including 7 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (69 of 128), TypeScript (44 of 128), React (39 of 128), LLM (38 of 128), Machine Learning (34 of 128), JavaScript (28 of 128), AWS (26 of 128)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 14 times since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

Salary context

37 other open postings titled Member of Technical Staff state a salary: median USD 180,000 to USD 300,000 a year.

Similar jobs

More jobs like this

Is this your posting? Email [email protected] to have it removed.