Staff Software Engineer, Applied AI
- Salary
- $200,000 - $275,000
- Level
- Staff
- Work type
- On-site · Burlingame
Not stated in the posting: visa.
Open. First seen 8 November 2026.
About the role
SuperDial is seeking a Staff Software Engineer, Applied AI to build and scale the backend systems that power LLM applications in healthcare. This role is ideal for an engineer who thrives at the intersection of backend architecture and applied AI, designing APIs, pipelines, and infrastructure that make LLMs reliable, secure, and cost-efficient in production. If you want to push LLMs beyond demos into mission-critical healthcare workflows, we’d love to hear from you.
About the Role:
- Backend for LLMs – Architect and implement scalable, low-latency APIs and services that wrap, orchestrate, and optimize LLMs for healthcare use cases.
- Data & Retrieval Pipelines – Build ingestion, preprocessing, and retrieval-augmented generation (RAG) pipelines to ground LLMs in clinical and revenue-cycle data.
- LLMOps & Observability – Design systems for model monitoring, evaluation, cost tracking, and guardrails, ensuring reliability and responsible use.
- Performance & Optimization – Engineer solutions for caching, batching, load balancing, and scaling LLM workloads across cloud and containerized environments.
- Security & Compliance – Implement HIPAA-ready infrastructure, data governance, and auditability for LLM-powered applications.
- Cross-Functional Collaboration – Partner with product, ML engineers, and healthcare experts to translate business workflows into robust backend systems.
- Technical Leadership – Drive end-to-end delivery of LLM backend projects, establish engineering best practices, and mentor peers in LLM system design.
About You:
- 5+ years of backend or full-stack software engineering experience, with 3+ years working on ML/LLM-enabled applications.
- Strong coding skills in Python (and ideally one statically typed language such as Go, Java, or TypeScript).
- Experience with LLM integration frameworks (Hugging Face, LangChain, LlamaIndex, OpenAI APIs, Anthropic, etc.).
- Deep knowledge of distributed systems, service-oriented architecture, and building APIs at scale.
- Cloud-native expertise: AWS/GCP/Azure, Kubernetes, Docker, Terraform, etc.
- Familiarity with MLOps/LLMOps practices: CI/CD for models, evaluation harnesses, monitoring, and reproducibility.
- Excellent system design skills and the ability to align technical architecture with product goals.
Preferred Qualifications:
- Experience applying LLMs in healthcare or other regulated industries (FHIR, HL7, HIPAA).
- Hands-on experience with RAG pipelines, vector databases, and structured-output orchestration.
- Background in enterprise SaaS or mission-critical platforms where uptime, latency, and scale matter.
- Knowledge of responsible AI, safety, and privacy-preserving ML techniques.
What’s in it for you?
- The opportunity to apply cutting-edge AI to one of the world’s most important industries.
- A leadership role with ownership over core ML/LLM systems and influence on technical direction.
- Competitive salary, equity options, and benefits, including health, dental, and vision coverage.
Who We Are
SuperDial is transforming AI in healthcare by building scalable, AI-powered solutions that optimize revenue cycle management. Join us and help shape the future of AI in healthcare.
Compensation: The base salary for this role ranges from $200,000 to $275,000, depending on experience and qualifications. We also offer equity and benefits as part of our total compensation package.
The team: Engineering HIRES STEADILY
This role is one of 3 open in Engineering. 1 was posted in the last 30 days and the oldest in July: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
GCP (3 of 3), Python (3 of 3), AWS (2 of 3), Docker (2 of 3), Kubernetes (2 of 3), LLM (2 of 3), Machine Learning (2 of 3)
OTHER ROLES ON THIS TEAM
- Tech Lead, Software Engineering posted Aug 31
- Sr. Software Engineer I posted Jul 5
From the team and dates on SuperDial's own job board.
Salary context
6 other open postings titled Staff Software Engineer, Applied AI state a salary: median USD 200,000 to USD 275,000 a year.
Similar jobs
- Director of Enterprise AI at Boomi
Shares 16 skills: Hugging Face, LangChain, MLOps… · same country - AI Solutions Architect at Accenture Federal Services
Shares 15 skills: Hugging Face, LangChain, MLOps… · same country - Forward Deployed Engineer - DevOps at Seekr
Shares 16 skills: Hugging Face, LangChain, Vector Databases… · same country - Technical Lead at Zaizi
Shares 17 skills: Hugging Face, LangChain, MLOps… - Principal Software AI Engineer (R-20113) at Dun & Bradstreet
Shares 14 skills: Hugging Face, LangChain, MLOps… · Staff level - Head of Security & IT at SuperDial
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.