True Talent Solutions Partners

Machine Learning Infrastructure Engineer

San Francisco
Salary
$200K - $400K
Level
Mid
Work type
On-site · San Francisco
Visa
Not offered

Open. First seen 19 November 2026.

About the role

About the Role

Join an AI team building large physics foundation models to predict real-world systems and identify effective actions. You will develop the distributed infrastructure that supports model training and inference, with weather data as a key application area.

What You'll Do

  • Design, deploy, and maintain distributed machine learning training and inference clusters.
  • Build scalable end-to-end pipelines for petabyte-scale datasets and model training across the ML lifecycle.
  • Evaluate training approaches, including parallelization methods and numerical precision trade-offs across model sizes.
  • Profile and debug low-level GPU operations to improve performance.
  • Track relevant research and apply promising ideas to infrastructure and workflows.

What We're Looking For

  • Two to ten years of experience building large-scale infrastructure for pretrained or foundation models, including compute clusters, data infrastructure, inference, and distributed training.
  • Hands-on experience optimizing large-scale training, data, or inference workloads, and using distributed training frameworks such as FSDP or DeepSpeed.
  • Experience with low-level GPU performance analysis and debugging, including CUDA and JAX.
  • Familiarity with Python, C++, Linux, NVIDIA GPUs, cloud platforms such as GCP, AWS, or Azure, and containerization and orchestration tools such as Docker and Kubernetes.
  • Background in physical AI or AI for science, such as robotics, autonomous systems, or biology, and motivation to work on scientific or physical-world applications.
  • Comfort working across the ML lifecycle in a fast-paced environment, including analyzing experiments and ablation studies.

Compensation & Benefits

Base salary is $200,000 to $400,000 annually. Visa sponsorship is not available.

Location

On-site in San Francisco, California. Relocation support is provided.

What this role asks for

Particular to this role

C++ · CUDA · GCP

Rare in True Talent Solutions Partners's other 106 open postings.

Standard for DevOps / SRE / cloud roles

AWS · Azure · Docker · Kubernetes · Linux · Python

Common in DevOps / SRE / cloud postings at any company.

Compared with True Talent Solutions Partners's other open jobs.

The team: Client Roles

This role is one of 107 open in Client Roles. 107 were posted in the last 30 days, including 5 lead roles: the team is hiring the people who run it too.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Python (59 of 107), LLM (34 of 107), TypeScript (32 of 107), React (29 of 107), Machine Learning (28 of 107), AWS (26 of 107), Kubernetes (20 of 107)

OTHER ROLES ON THIS TEAM

From the team and dates on True Talent Solutions Partners's own job board.

Posting history

Reposted 4 times since 29 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.

Salary context

8 other open postings titled Machine Learning Infrastructure Engineer state a salary: median USD 200,000 to USD 350,000 a year.

Similar jobs

More jobs like this

Is this your posting? Email [email protected] to have it removed.