Machine Learning Infrastructure Engineer
- Salary
- $200,000 - $300,000 per year
- Level
- Mid
Not stated in the posting: work type, visa.
Open. First seen 23 October 2026.
About the role
About the company
Our client is a fast-growing software company.
The role
Raydar is recruiting for this role on behalf of our client. Own and scale the systems that train and run machine learning models in production, partnering with researchers so new models ship quickly and dependably. This is an individual contributor role for a versatile engineer who understands how models behave under load and can improve speed, stability and spend.
What you'll do
- Run and enhance the production systems that deliver model predictions, with a focus on latency, observability and uptime.
- Set up and refine training environments for models across a broad range of sizes.
- Develop logging, metrics and alerting across the machine learning stack.
- Create internal data pipelines and tools that shorten the path from research experiment to production release.
- Design infrastructure that distributes workloads across several cloud vendors, balancing quality, response time and cost.
Requirements
What we're looking for
- 3+ years of experience in machine learning infrastructure.
- Proven track record operating production model deployment systems in a demanding, high-performing engineering team.
- Strong Python skills and systems engineering experience with Kubernetes.
- Deep expertise in diagnosing GPU performance limits, tuning model deployment and monitoring.
- Comfort working in a fast-paced startup environment.
Bonus points
- Hands-on experience with training and deployment on a small number of machines.
- Prior work at a startup that develops its own models.
- Technical degree from a leading program.
- Research publications at top machine learning venues.
- Open source contributions in machine learning tooling.
- Strong results in math or computer science competitions.
Benefits
Compensation and benefits
- Base salary: USD 200,000 to 300,000 per year
- Equity
- Health, dental and vision coverage
- Parental leave
- Flexible time off
Location and work model
- San Francisco, California, United States
- On-site, 5 days per week in office
- Full-time
What this role asks for
Standard for DevOps / SRE / cloud roles
Kubernetes · Python
Common in DevOps / SRE / cloud postings at any company.
Compared with Raydar's other open jobs.
Other openings for this role
5 open postings for this role in San Francisco, first posted 23 October 2026. The company is likely hiring for more than one position. None has been taken down and posted again.
- 14 November 2026 – open
- 26 October 2026 – open
- 26 October 2026 – open
- 23 October 2026 – open
- 23 October 2026 – open (this posting)
Salary context
7 other open postings titled Machine Learning Infrastructure Engineer state a salary: median USD 200,000 to USD 350,000 a year.
Similar jobs
- Machine Learning Infrastructure Engineer, Technology at Point72
Shares 3 skills: Kubernetes, Machine Learning, Python · same seniority · same country - Full-Stack Software Engineer, Reinforcement Learning at Clera
Shares 3 skills: Kubernetes, Machine Learning, Python · same seniority · same city - Software Engineer, Marketplace at True Talent Solutions Partners
Shares 3 skills: Kubernetes, Machine Learning, Python · same seniority · same city · ✓ Visa sponsorship - AI/ML Software Engineer, Platform at Falcomm
Shares 3 skills: Kubernetes, Machine Learning, Python · same seniority · same country - Forward Deployed Engineer at OpenTeams
Shares 3 skills: Kubernetes, Machine Learning, Python · same seniority · same country - VP of Engineering at Raydar
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.