AI Engineer
- Salary
- $200K - $250K
- Level
- Junior
- Work type
- On-site · San Francisco
Not stated in the posting: visa.
Open. First seen 14 March 2026.
About the role
LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.
What you will be working on
Skills: Python, LLM APIs, FastAPI
As the AI Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:
- System design for supporting provider level features at the gateway level (skills, compaction, batches, etc.)
- Thinking about the developer experience - to support millions of users who leverage your work via LiteLLM's Python SDK
- Building across LLM's, MCP's, and Agents by maintaining an excellent LLM interoperability layer, supporting a wide range of MCP Auth flows and enabling various Agent use-cases
What is our tech stack
The tech stack includes Python, FastAPI, Redis, Postgres.
Who we are looking for
- 1-2 years of backend/full-stack experience with production systems
- Passion for open source and user engagement
- Experience working with the OpenAI api (understand the difference between /chat/completions and /responses, and can speak to API-specific nuances)
- Strong work ethic and ability to thrive in small teams
- Eagerness to talk to users and help solve real problems
Why Join LiteLLM?
- Work directly with the founders every day.
- Build products used by thousands of engineering teams around the world.
- Own meaningful product decisions—not just implementation.
- Move incredibly fast and see your work in production immediately.
- Help define the future of AI infrastructure and developer tooling.
- Competitive salary, equity, health, dental, and vision benefits.
About LiteLLM
LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.
If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.
What this role asks for
In most of LiteLLM's ads
Python
Named in most of its open postings, whatever the role.
Compared with LiteLLM's other open jobs.
The team: Engineering HIRES STEADILY
This role is one of 9 open in Engineering. 6 were posted in the last 30 days and the oldest in July: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
LLM (9 of 9), Python (7 of 9), FastAPI (4 of 9), PostgreSQL (4 of 9), Redis (4 of 9), GitHub (3 of 9), CI/CD (2 of 9)
OTHER ROLES ON THIS TEAM
- ML Engineer posted Nov 11
- Staff Engineer, Systems and Reliability posted Nov 9
- Staff Engineer, AI posted Nov 9
- Senior Security Operations / Detection Engineer posted Nov 5
- Senior Security Engineer, Product & Platform posted Nov 5
- Senior Security Engineer posted Oct 31
- Senior Support Engineer, EMEA and APAC posted Jul 24
- Senior Support Engineer, EMEA and APAC posted Jul 7
From the team and dates on LiteLLM's own job board.
Salary context
51 other open postings titled AI Engineer state a salary: median USD 154,560 to USD 225,000 a year.
Similar jobs
- Software engineer, generative AI at WRITER
Shares 4 skills: FastAPI, PostgreSQL, LLM… · same city - AI Software Engineer, Full Stack Product at Falcomm
Shares 4 skills: FastAPI, PostgreSQL, LLM… · same country - AI Engineer at AJAIA
Shares 4 skills: FastAPI, PostgreSQL, LLM… · same country - Applied AI Engineer at Foresight Works Ltd
Shares 4 skills: FastAPI, PostgreSQL, LLM… · same country - AI Product Operator Intern at Niural
Shares 4 skills: FastAPI, PostgreSQL, LLM… · same country - ML Engineer at LiteLLM
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.