Machine Learning Infrastructure Engineer
- Salary
- $200K - $400K
- Level
- Mid
- Work type
- On-site · San Francisco
- Visa
- Not offered
Open. First seen 19 November 2026.
About the role
About the Role
Join an AI team building large physics foundation models to predict real-world systems and identify effective actions. You will develop the distributed infrastructure that supports model training and inference, with weather data as a key application area.
What You'll Do
- Design, deploy, and maintain distributed machine learning training and inference clusters.
- Build scalable end-to-end pipelines for petabyte-scale datasets and model training across the ML lifecycle.
- Evaluate training approaches, including parallelization methods and numerical precision trade-offs across model sizes.
- Profile and debug low-level GPU operations to improve performance.
- Track relevant research and apply promising ideas to infrastructure and workflows.
What We're Looking For
- Two to ten years of experience building large-scale infrastructure for pretrained or foundation models, including compute clusters, data infrastructure, inference, and distributed training.
- Hands-on experience optimizing large-scale training, data, or inference workloads, and using distributed training frameworks such as FSDP or DeepSpeed.
- Experience with low-level GPU performance analysis and debugging, including CUDA and JAX.
- Familiarity with Python, C++, Linux, NVIDIA GPUs, cloud platforms such as GCP, AWS, or Azure, and containerization and orchestration tools such as Docker and Kubernetes.
- Background in physical AI or AI for science, such as robotics, autonomous systems, or biology, and motivation to work on scientific or physical-world applications.
- Comfort working across the ML lifecycle in a fast-paced environment, including analyzing experiments and ablation studies.
Compensation & Benefits
Base salary is $200,000 to $400,000 annually. Visa sponsorship is not available.
Location
On-site in San Francisco, California. Relocation support is provided.
What this role asks for
Particular to this role
C++ · CUDA · GCP
Rare in True Talent Solutions Partners's other 106 open postings.
Standard for DevOps / SRE / cloud roles
AWS · Azure · Docker · Kubernetes · Linux · Python
Common in DevOps / SRE / cloud postings at any company.
Compared with True Talent Solutions Partners's other open jobs.
The team: Client Roles
This role is one of 107 open in Client Roles. 107 were posted in the last 30 days, including 5 lead roles: the team is hiring the people who run it too.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Python (59 of 107), LLM (34 of 107), TypeScript (32 of 107), React (29 of 107), Machine Learning (28 of 107), AWS (26 of 107), Kubernetes (20 of 107)
OTHER ROLES ON THIS TEAM
- System Engineer Softwareverteilung & Client Management posted Nov 19
- Forward Deployed Engineer posted Nov 19
- Founding Forward Deployed Engineer posted Nov 19
- Software Engineer, RL Environments posted Nov 19
- Lead Platform Engineer posted Nov 19
- Technical Product Manager posted Nov 19
- Product Engineer, Full Stack posted Nov 19
- Product Manager, Product Growth posted Nov 19
- Founding Full-Stack Engineer posted Nov 19
- Founding Product Engineer posted Nov 19
- AI-Native Electrical Engineer posted Nov 19
- Member of Technical Staff posted Nov 19
- Founding Engineer posted Nov 19
- AI Forward Deployed Engineer posted Nov 19
- Robotics Test Engineer posted Nov 19
- Senior System Administrator posted Nov 19
- Member of Technical Staff posted Nov 19
- Sales Engineer posted Nov 19
- Senior DevSecOps Engineer posted Nov 19
- Senior Platform Engineer, Linux & Kubernetes on Bare Metal posted Nov 19
- Cloud Operations Engineer posted Nov 19
- Network Engineer posted Nov 19
- Information Security Officer (ISB) posted Nov 19
- GTM Engineer posted Nov 19
- Senior/Staff Engineer posted Nov 19
- AI Field Engineer, AI Natives posted Nov 19
- AI Native Sales Manager posted Nov 19
- Forward Deployed Software Engineer, Tactical Edge posted Nov 19
- Senior Analog/Mixed Signal Engineer posted Nov 19
- Founding Forward Deployed Engineer posted Nov 19
- Principal Analog/Mixed Signal Engineer posted Nov 19
- Forward Deployed Engineer, Infrastructure posted Nov 19
- Senior Platform Engineer posted Nov 19
- Senior Security Engineer posted Nov 19
- Mechanical Design Engineer posted Nov 19
- Electrical Engineer posted Nov 19
- Software Engineer, Marketplace posted Nov 19
- Lead AI Engineer posted Nov 19
- Member of Technical Staff posted Nov 19
- Full Stack Engineer posted Nov 19
- Member of Technical Staff, Agent Platform posted Nov 18
- Senior Full-Stack Software Engineer posted Nov 18
- Software Engineer posted Nov 18
- Senior AI/ML Engineer posted Nov 18
- Senior Software Engineer posted Nov 18
- Software Engineer, Distributed Systems (Core) posted Nov 18
- Product Manager, Supply Chain posted Nov 18
- Product Lead, Agentic Personalization posted Nov 18
- Senior Software Engineer, Autonomous Systems posted Nov 18
- Full-Stack Software Engineer posted Nov 18
- Senior AI Scheduler posted Nov 18
- Product Manager, AI Platform posted Nov 18
- Forward Deployed Engineer posted Nov 18
- Founding Research Engineer, Robot Learning posted Nov 18
- Research Crawling Engineer posted Nov 18
- Founding Product Engineer posted Nov 18
- Head of RF Engineering posted Nov 18
- Software Engineer, Security posted Nov 18
- Founding Engineer, Applied AI posted Nov 18
- Founding Product Designer posted Nov 18
- Founding AI Agent Engineer posted Nov 18
- Senior Software Engineer, Customer Studio Backend posted Nov 18
- Founding ML Research Engineer posted Nov 18
- Senior Forward Deployed Engineer, Operate posted Nov 18
- Software Engineer, C++ Systems posted Nov 18
- Founding Software Engineer posted Nov 18
- Engineering Manager, Security Platform posted Nov 18
- Senior Software Engineer, Design posted Nov 18
- Lead Platform Engineer posted Nov 18
- Technical Product Manager, Senior posted Nov 18
- Member of Technical Staff, Full Stack posted Nov 18
- Software Engineer, AI Agents posted Nov 18
- Staff Product Manager, AI posted Nov 18
- Product Engineer posted Nov 18
- Founding AI Engineer posted Nov 18
- Software Engineer, iOS posted Nov 18
- Senior Infrastructure Engineer posted Nov 18
- Principal Software Engineer, Perception posted Nov 18
- Member of Technical Staff, Reinforcement Learning posted Nov 18
- Solutions Engineer posted Nov 18
- Electrical & Computer Engineer posted Nov 18
- Senior Power Electronics Engineer posted Nov 18
- Lead Product Engineer posted Nov 18
- Senior Solutions Engineer, Digital Native and Mid-Market posted Nov 18
- Mid/Senior Full Stack AI Engineer posted Nov 18
- Staff Product Manager posted Nov 18
- Engineering Lead posted Nov 18
- Forward Deployed Product Manager posted Nov 18
- Director of Engineering (Product) posted Nov 18
- Founding Senior Engineer posted Nov 18
- Staff Full-Stack Engineer, Core Application posted Nov 18
- Robotics Software Engineer posted Nov 18
- Technical Recruiter posted Nov 18
- Audiobook QA Expert, Dutch posted Nov 18
- Senior Applied AI Product Designer posted Nov 18
- Member of Technical Staff, ML Systems posted Nov 18
- Product Engineer, Mid-Senior posted Nov 17
- Staff Software Engineer, Infrastructure posted Nov 17
- Software Engineer posted Nov 17
- Senior/Staff Product Engineer, Applied AI posted Nov 17
- Data Architect (m/w/d) posted Nov 17
- Engineering Manager posted Nov 16
- Senior Data & Machine Learning Engineer posted Nov 16
- Founding RL Engineer posted Nov 16
- Senior Quantitative Developer posted Nov 16
- Founding Forward Deployed Engineer posted Nov 16
From the team and dates on True Talent Solutions Partners's own job board.
Posting history
Reposted 4 times since 29 October 2026: a posting for this role in San Francisco was taken down and the role was posted again.
- 19 November 2026 – open (this posting)
- 12 November 2026 – closed 15 November 2026
- 10 November 2026 – closed 12 November 2026
- 5 November 2026 – closed 9 November 2026
- 29 October 2026 – closed 2 November 2026
Salary context
8 other open postings titled Machine Learning Infrastructure Engineer state a salary: median USD 200,000 to USD 350,000 a year.
Similar jobs
- Software Engineer - AI Compute Infrastructure at ByteDance
Shares 9 skills: CUDA, Docker, C++… · same seniority · same country - Software Engineer: Perception (II,III) at Lodestar
Shares 10 skills: CUDA, Docker, C++… · same seniority · same country - Machine Learning Engineer at Mach Industries
Shares 6 skills: CUDA, Docker, C++… · same seniority · same country - AI Infrastructure Engineer at Mercor
Shares 7 skills: CUDA, C++, GCP… · same seniority · same city - Senior MLOps Engineer at Salvo Software
Shares 9 skills: CUDA, Docker, Linux… · same country - System Engineer Softwareverteilung & Client Management at True Talent Solutions Partners
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.