True Talent Solutions Partners

Machine Learning Infrastructure Engineer

San Francisco
Salary
$200,000 - $400,000 annually
Level
Mid
Work type
On-site · San Francisco
Visa
Not offered

Open. First seen 29 October 2026.

Apply on the company's site →

About the role

About the Role

Join an AI team building foundation models for physical systems, starting with weather. You will develop the distributed infrastructure that enables large-scale model training and inference, helping advance AI for scientific and real-world applications.

What You'll Do

  • Design, deploy, and maintain distributed machine learning training and inference clusters.
  • Build scalable end-to-end pipelines for petabyte-scale datasets and model training across the machine learning lifecycle.
  • Research and evaluate training approaches, including parallelization strategies and numerical precision trade-offs across model scales.
  • Profile and debug low-level GPU operations to improve performance.
  • Track relevant research and apply promising ideas to infrastructure and model development.

What We're Looking For

  • Two to ten years of experience building large-scale machine learning infrastructure for pretrained foundation models.
  • Experience with distributed training frameworks such as FSDP or DeepSpeed, and with optimizing large-scale training, data, or inference workloads.
  • Strong background in distributed compute, data infrastructure, inference systems, and model serving.
  • Familiarity with GPU performance optimization and debugging, including CUDA and JAX, and with Python, C++, Linux, and NVIDIA hardware.
  • Knowledge of cloud platforms such as GCP, AWS, or Azure, and containerization and orchestration tools such as Docker and Kubernetes.
  • Experience in physical AI or AI for science, such as robotics, autonomous systems, or biology, and motivation to work on scientific or physical-world applications.
  • Comfort working across the machine learning lifecycle in fast-paced, time-sensitive environments; experience analyzing training experiments and ablation studies is valuable.

Compensation & Benefits

Base salary: $200,000 to $400,000 annually. Visa sponsorship is not available.

Location

On-site, five days per week in San Francisco, California. Relocation support is provided.

What this role asks for

Particular to this role

C++ · CUDA

Rare in True Talent Solutions Partners's other 126 open postings.

Standard for DevOps / SRE / cloud roles

AWS · Azure · Docker · GCP · Kubernetes · Linux · Python

Common in DevOps / SRE / cloud postings at any company.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 125 open in Client Roles. 125 were posted in the last 30 days, including 5 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (72 of 125), TypeScript (47 of 125), LLM (43 of 125), React (38 of 125), Machine Learning (34 of 125), AWS (26 of 125), JavaScript (25 of 125)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Salary context

7 other open postings titled Machine Learning Infrastructure Engineer state a salary: median USD 200,000 to USD 350,000 a year.

Similar jobs

More jobs like this

SKILLSPython 46,236AWS 26,406Machine Learning 19,848Azure 17,354DevOps 5,831
PLACESSan Francisco 7,783United States 72,462
COMPANYJobs at True Talent Solutions Partners 125

Is this your posting? Email info@careerholo.com to have it removed.