Inference Engineer - Member of Technical Staff
- Level
- Staff
- Work type
- Hybrid · Bellevue
Not stated in the posting: salary, visa.
Open. First seen 10 November 2026.
About the role
Inference Engineer - Member of Technical Staff
Location: Hybrid | Bellevue, WA (downtown)
Multiple Levels and roles available
Build the Inference Platform Powering Next-Generation AI Applications
About the Opportunity
A well-funded, rapidly growing AI infrastructure company is building a next-generation cloud platform designed to power the full lifecycle of artificial intelligence. The organization is developing a comprehensive AI infrastructure, platform, and services portfolio that supports the full spectrum of AI workloads—including large-scale compute, model training, fine-tuning, inference, and emerging agentic AI applications.
Backed by significant long-term investment, the company combines the speed, ownership, and innovation of a startup with the stability and resources of an established parent organization. Engineering teams are intentionally lean, highly collaborative, and AI-native, leveraging modern tooling and automation to build infrastructure capable of supporting the industry's most demanding AI workloads.
We're seeking Inference Engineers to build and operate the model-serving systems behind a next-generation AI inference platform. This team focuses on delivering high-throughput, low-latency, reliable inference experiences that enable customers to consume advanced AI capabilities through production-scale APIs.
The Opportunity
This is a foundational engineering role focused on building the systems that bring AI models from research environments into reliable production services. You'll work on the infrastructure layer responsible for serving large models efficiently, optimizing performance, and ensuring reliability as usage scales.
You'll collaborate closely with GPU performance, AI training infrastructure, platform engineering, and operations teams to solve complex challenges around model serving, latency optimization, resource efficiency, and production reliability.
This opportunity is ideal for engineers who enjoy working at the intersection of distributed systems, machine learning infrastructure, GPU computing, and large-scale production systems.
What You'll Do
- Build and operate production-grade model-serving and inference systems supporting high-throughput, low-latency AI workloads.
- Optimize inference infrastructure for token throughput, latency, scalability, and cost efficiency across different model architectures and workloads.
- Design systems that maximize GPU utilization while maintaining predictable performance and reliability.
- Improve the scalability and operational maturity of inference platforms as customer demand grows.
- Partner with AI training, GPU performance, orchestration, and infrastructure teams to ensure smooth transitions from model development to production serving.
- Develop monitoring, alerting, and operational practices to maintain reliable inference services.
- Investigate and resolve performance, reliability, and capacity challenges across inference workloads.
- Contribute to architecture decisions and engineering standards as the platform evolves.
What We're Looking For
- Experience building and operating production machine learning inference or model-serving systems at scale.
- Strong understanding of the performance trade-offs involved in serving large AI models, including latency, throughput, memory utilization, and cost efficiency.
- Experience designing reliable distributed systems or production infrastructure.
- Understanding of GPU-backed AI workloads and the challenges of scaling inference systems.
- Strong engineering fundamentals and the ability to independently own complex technical problems.
- Comfortable working in a fast-moving environment where systems and processes are being built from the ground up.
Preferred Qualifications
- Experience with modern inference-serving frameworks such as vLLM, SGLang, TensorRT-LLM, Triton Inference Server, or similar technologies.
- Experience optimizing LLM inference workloads or large-scale AI serving platforms.
- Background operating API-based AI products or high-volume production services.
- Experience with GPU scheduling, distributed systems, Kubernetes, or cloud infrastructure platforms.
- Familiarity with model optimization techniques such as quantization, batching, caching, or performance tuning.
- Experience working at a hyperscaler, AI lab, GPU cloud provider, or large-scale ML infrastructure organization.
Compensation
- Competitive base pay for Bellevue market
- Certain roles are eligible for additional rewards, including merit increases, annual bonus, and long term incentives. These awards are allocated based on individual performance
- U.S. based employees have access to medical, dental, and vision insurance, a 401(k) plan and company match, employees also receive per calendar year, paid holidays.
Location
- Hybrid role based in the Bellevue, WA area.
- Approximately three days per week in the office.
- Candidates elsewhere in the U.S. who are open to relocation are encouraged to apply.
- U.S. work authorization is required.
Why Join?
- Build the inference platform powering the next generation of AI applications.
- Work directly on large-scale model serving, GPU optimization, and production AI systems.
- Solve complex challenges around latency, throughput, reliability, and cost efficiency.
- Join early enough to influence architecture, tooling, and engineering practices.
- Collaborate with a highly experienced team building critical AI infrastructure from the ground up.
- Enjoy the ownership and technical impact of a startup environment backed by significant long-term investment.
What this role asks for
Particular to this role
LLM
Rare in Designworks Talent's other 15 open postings.
Compared with Designworks Talent's other open jobs.
The team: AI Infrastructure
This role is one of 10 open in AI Infrastructure. 7 were posted in the last 30 days.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Machine Learning (5 of 10), Kubernetes (4 of 10), CUDA (2 of 10), Linux (2 of 10), LLM (2 of 10), PyTorch (2 of 10)
OTHER ROLES ON THIS TEAM
- HPC/GPU Data Center Network Engineer - Member of Technical Staff posted Nov 10
- HPC/GPU Hardware /Machine Design Engineer - Member of Technical Staff posted Nov 10
- Virtualization & Orchestration Engineer - Member of Technical Staff posted Nov 10
- HPC/GPU Performance / Kernel Engineer - Member of Technical Staff posted Nov 10
- HPC/GPU Infrastructure Software Engineer - Member of Technical Staff posted Nov 10
- AI Training Infrastructure - Member of Technical Staff posted Nov 10
- Applied Researcher – Network Expert posted Oct 7
- Applied Researcher – Data Centers posted Oct 7
- Applied Researcher – AI Expert posted Oct 7
From the team and dates on Designworks Talent's own job board.
Similar jobs
- Technical Lead, Backend Systems at Distributed Spectrum
Shares 3 skills: Kubernetes, Machine Learning, LLM · same country - Sr. Superintelligence (SI) Engineer, Special Programs at SpaceX
Shares 3 skills: Kubernetes, Machine Learning, LLM · same country - Senior AI Architect at Weekday AI
Shares 3 skills: Kubernetes, Machine Learning, LLM · same country - AI Platform Architect at Graphcore
Shares 3 skills: Kubernetes, Machine Learning, LLM · same country - Member of Technical Staff - Software Systems Engineering, Software Development at Reasonable AI
Shares 2 skills: Kubernetes, Machine Learning · Staff level - Virtualization & Orchestration Engineer - Member of Technical Staff at Designworks Talent
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.