True Talent Solutions Partners

Member of Technical Staff, ML Systems

Menlo Park
Salary
$180,000 - $260,000 annually
Level
Staff
Work type
On-site · Menlo Park
Visa
Sponsors visas

Open. First seen 7 November 2026.

Apply on the company's site →

About the role

About the Role

Join an AI systems team rebuilding the training and inference stack for image, video, and world-model workloads. You will improve performance across GPU kernels, distributed engines, and multi-node systems, helping make demanding model workloads faster and more efficient.

What You'll Do

  • Optimize training and inference performance for image, video, and world-model workloads.
  • Profile bottlenecks at the kernel, memory, system, and cluster levels using Nsight and related tools.
  • Implement low-level GPU optimizations in CUDA and Triton.
  • Design and improve distributed training and inference engines for diffusion models.
  • Improve communication performance across GPUs and nodes using NCCL, RDMA, InfiniBand, RoCE, and disaggregated serving approaches.
  • Build benchmarks and regression tests to preserve performance gains in production.
  • Co-design kernels, runtimes, and models with hardware characteristics in mind.

What We're Looking For

  • At least 2 years of experience in deep learning training or inference systems, distributed systems, or related ML systems work, with 1 or more years of hands-on GPU performance experience in a recent role.
  • Experience authoring core features in an inference or training framework, such as vLLM, SGLang, TensorRT-LLM, Megatron, or a comparable system.
  • Direct experience writing GPU kernels for NVIDIA hardware using CUDA, CUTLASS, Triton, or PTX.
  • Strong machine learning and computer science fundamentals, supported by a degree in computer science or a related quantitative field.
  • Experience optimizing training or inference performance across GPU kernels, runtimes, or distributed execution.
  • Experience with PyTorch, Nsight, NCCL, and RDMA, and ideally optimization of diffusion, video, image, or other multimodal workloads.

Compensation & Benefits

Base salary: $180,000 to $260,000 annually. Visa sponsorship is available.

Location

On-site in Menlo Park, California, United States.

What this role asks for

Particular to this role

CUDA · Deep Learning

Rare in True Talent Solutions Partners's other 121 open postings.

Standard for data science / ML roles

LLM · Machine Learning · PyTorch

Common in data science / ML postings at any company.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 122 open in Client Roles. 122 were posted in the last 30 days, including 5 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (67 of 122), LLM (48 of 122), TypeScript (39 of 122), React (36 of 122), Machine Learning (32 of 122), AWS (31 of 122), JavaScript (21 of 122)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 8 times since 27 October 2026: a posting for this role in Menlo Park was taken down and the role was posted again.

Similar jobs

More jobs like this

SKILLSMachine Learning 20,763LLM 19,799PyTorch 4,959Deep Learning 3,065AI and machine learning 9,272
PLACESMenlo Park 261United States 78,233
COMPANYJobs at True Talent Solutions Partners 122

Is this your posting? Email info@careerholo.com to have it removed.