Senior Software Engineer, AI Gateway - Shanghai
- Level
- Senior
- Work type
- On-site · Shanghai
Not stated in the posting: salary, visa.
Open. First seen 23 October 2026.
About the role
Kong's standard text
Are you ready to unlock intelligence?
If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.
About the Role:
As Kong advances into the Agentic Era, the AI Gateway team is developing the vital infrastructure that links enterprise systems with generative AI technologies. In this position, you will focus on engineering the core system powering live AI traffic. You will take ownership of the runtime and data plane responsible for routing, translating, securing, and analyzing every request, ensuring performance, security, and scalability as AI workloads expand.
What You'll Do:
- Responsible for designing, building, and maintaining Kong's AI Gateway runtime and its underlying data plane stack.
- Architect, design, and implement new innovative features, including proxying capabilities, semantic/intelligent routing, load balancing, guardrails and compression, and identity, that extend Kong's AI Gateway offering.
- Build and maintain security, performance, and compliance foundations, including token cost management, access control, and low-level optimizations for production AI workloads.
- Partner with technical support engineers to resolve customer-reported issues end to end — from investigation and solution design through coding and release.
- Engage with the open source community and extend Kong core to support the latest industry trends.
- Fill the gaps between Kong AI Gateway and third-party AI/ML providers, deployment platforms, and tooling.
- And any additional tasks required by the manager.
What You'll Bring:
- 6+ years of programming experience in server-side applications and components.
- Experienced in designing, prototyping, building, and debugging highly scalable, distributed, reliable, and resilient applications.
- Solid hands-on, low-level technical expertise in Linux systems troubleshooting and profiling.
- Experienced in distributed systems, the Linux networking stack, and computer systems programming.
- Solid design and coding practices; skilled at code review and mentoring junior engineers.
- Comfortable working with remotely distributed teams.
- Excellent verbal and written communication skills across stakeholder groups: including engineers, product managers, support engineers, and customers.
- Strong sense of ownership, self-driven and proactive, with the ability to take initiative and drive work forward to tangible outcomes.
- Able to handle urgent issues under pressure while maintaining high quality, even in emergency situations.
- Familiar with AI LLM concepts and application development.
Bonus Points:
- Hands-on experience with NGINX/OpenResty/Kong/LuaJIT.
- Hands-on experience with Envoy or Istio.
- Hands-on experience with Rust.
- Hands-on experience leveraging AI agents to deliver intricate software systems efficiently and with superior quality.
#LI-WL1
Kong's standard text
About Kong:
Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit www.konghq.com.
What this role asks for
Particular to this role
Envoy · Generative AI · Rust
Rare in Kong's other 56 open postings.
76% of this description is written for the role. The rest is Kong's standard text, folded away below.
Compared with Kong's other open jobs.
The team: ENG HIRES STEADILY
This role is one of 30 open in ENG. 19 were posted in the last 30 days and the oldest in March: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Kubernetes (21 of 30), Golang (20 of 30), Istio (16 of 30), LLM (15 of 30), AWS (14 of 30), Nginx (14 of 30), Azure (13 of 30)
OTHER ROLES ON THIS TEAM
- Senior Software Engineer - Kubernetes posted Nov 12
- Senior Software Engineer, Gateway - Shanghai posted Nov 10
- Senior Software Engineer, Control Planes posted Nov 9
- Software Engineer 2 posted Nov 2
- Senior Software Engineer posted Oct 28
- Platform Engineering Manager posted Oct 27
- Engineering Manager, Managed Gateways posted Oct 27
- Staff Software Engineer, Metering and Billing posted Oct 26
- Senior Software Engineer, Metering & Billing posted Oct 26
- Senior Software Engineer, Metering & Billing posted Oct 26
- Senior Software Engineer, AI Gateway posted Oct 26
- Senior Software Engineer, AI Gateway posted Oct 26
- Software Engineer, AI Gateway posted Oct 23
- Senior Software Engineer, Control Plane posted Oct 23
- Software Engineer posted Oct 23
- Senior Software Engineer, AI Gateway - Shanghai posted Oct 23
- Senior Software Engineer, AI Gateway - Shanghai posted Oct 23
- Senior Software Engineer, AI Gateway - Shanghai posted Oct 23
- Senior Software Engineer (Security Champion), Runtimes posted Oct 14
- Staff Product Manager, AI Management posted Oct 9
- Site Reliability Engineer 2 posted Oct 1
- Software Engineer 2, Managed Gateways posted Sep 21
- Staff Product Manager, AI Management posted Sep 17
- Staff Software Engineer, Konnect Core Platform posted Aug 17
- Software Engineering Manager, Managed Gateways SREs posted Jul 23
- Senior SRE, Managed Gateways posted Jul 23
- Software Engineer AI Gateway posted Jun 17
- Staff Software Engineer, Identity and Access Management posted Apr 15
- Software Engineer 2, Managed Gateways posted Mar 2
From the team and dates on Kong's own job board.
Other openings for this role
4 open postings for this role in Shanghai, China, first posted 23 October 2026. The company is likely hiring for more than one position. None has been taken down and posted again.
- 23 October 2026 – open
- 23 October 2026 – open (this posting)
- 23 October 2026 – open
- 23 October 2026 – open
Similar jobs
- Senior Software Engineer - Agentic AI security at Tigera
Shares 5 skills: Envoy, Istio, Rust… · Senior level - Software Engineer, Traffic Infrastructure at OpenAI
Shares 4 skills: Envoy, Nginx, Istio… · Senior level - Senior Software Engineer, Observability at Roku
Shares 4 skills: Envoy, Istio, Rust… · Senior level - Senior Software Engineer, Foundational Infrastructure & Networking at Lyft
Shares 4 skills: Envoy, Nginx, Istio… · Senior level - Senior Platform Security Engineer at Discord
Shares 4 skills: Envoy, Istio, Rust… · Senior level - Senior Director, Solutions Engineering at Kong
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.