True Talent Solutions Partners

Member of Technical Staff

San Francisco
Salary
$200,000 - $300,000 annually
Level
Staff
Work type
On-site · San Francisco
Visa
Sponsors visas

This posting has closed on 10 November 2026.

About the role

About the Role

Join a small AI infrastructure team building tools and systems that improve the performance and energy efficiency of machine learning inference. You will work across software, models, and heterogeneous hardware, helping deliver fast, reliable inference in production.

What You'll Do

  • Ship day-zero support for new open-source models, tuning them for latency and throughput.
  • Optimize inference serving systems, including batching, KV cache, speculative decoding, and quantization.
  • Write and tune kernels using CUDA, HIP, and Triton across a range of accelerator platforms.
  • Design, deploy, and operate heterogeneous clusters across hardware vendors.
  • Run production inference across mixed hardware fleets, improving reliability, observability, and cost per token.
  • Work with customers to understand their needs and help solve infrastructure challenges.

What We're Looking For

  • Typically 1 to 6 years of experience in backend, infrastructure, or systems engineering, including experience at scale or in an early-stage environment.
  • Strong understanding of computer architecture, memory hierarchy, and operating system internals beyond application-level development.
  • Low-level or systems engineering experience, with familiarity in CUDA, Triton, HIP, or other GPU programming tools.
  • Experience operating infrastructure at scale, such as clusters, data centers, or large GPU fleets, is valuable.
  • Knowledge of machine learning inference optimization, including quantization, batching, KV cache, or speculative decoding, is beneficial.
  • Strong CS fundamentals, demonstrated ownership of complex systems or technical projects, and experience using AI coding tools to improve workflows.
  • Comfort communicating with customers and working across a broad range of engineering problems.

Compensation & Benefits

Base salary: $200,000 to $300,000 annually. Visa sponsorship is available.

Location

On-site, five days per week in San Francisco, California.

The team: Client Roles

This role is one of 128 open in Client Roles. 128 were posted in the last 30 days, including 7 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (69 of 128), TypeScript (44 of 128), React (39 of 128), LLM (38 of 128), Machine Learning (34 of 128), JavaScript (28 of 128), AWS (26 of 128)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 14 times since 25 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

Salary context

38 other open postings titled Member of Technical Staff state a salary: median USD 180,000 to USD 300,000 a year.

Similar jobs

More jobs like this

Is this your posting? Email [email protected] to have it removed.