Kong

Senior Software Engineer, AI Gateway - Shanghai

Shanghai, China
Level
Senior
Work type
On-site · Shanghai

Not stated in the posting: salary, visa.

Open. First seen 23 October 2026.

About the role

Kong's standard text

Are you ready to unlock intelligence?

If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.

About the Role:

As Kong advances into the Agentic Era, the AI Gateway team is developing the vital infrastructure that links enterprise systems with generative AI technologies. In this position, you will focus on engineering the core system powering live AI traffic. You will take ownership of the runtime and data plane responsible for routing, translating, securing, and analyzing every request, ensuring performance, security, and scalability as AI workloads expand.

What You'll Do:

  • Responsible for designing, building, and maintaining Kong's AI Gateway runtime and its underlying data plane stack.
  • Architect, design, and implement new innovative features, including proxying capabilities, semantic/intelligent routing, load balancing, guardrails and compression, and identity, that extend Kong's AI Gateway offering.
  • Build and maintain security, performance, and compliance foundations, including token cost management, access control, and low-level optimizations for production AI workloads.
  • Partner with technical support engineers to resolve customer-reported issues end to end — from investigation and solution design through coding and release.
  • Engage with the open source community and extend Kong core to support the latest industry trends.
  • Fill the gaps between Kong AI Gateway and third-party AI/ML providers, deployment platforms, and tooling.
  • And any additional tasks required by the manager.

What You'll Bring:

  • 6+ years of programming experience in server-side applications and components.
  • Experienced in designing, prototyping, building, and debugging highly scalable, distributed, reliable, and resilient applications.
  • Solid hands-on, low-level technical expertise in Linux systems troubleshooting and profiling.
  • Experienced in distributed systems, the Linux networking stack, and computer systems programming.
  • Solid design and coding practices; skilled at code review and mentoring junior engineers.
  • Comfortable working with remotely distributed teams.
  • Excellent verbal and written communication skills across stakeholder groups: including engineers, product managers, support engineers, and customers.
  • Strong sense of ownership, self-driven and proactive, with the ability to take initiative and drive work forward to tangible outcomes.
  • Able to handle urgent issues under pressure while maintaining high quality, even in emergency situations.
  • Familiar with AI LLM concepts and application development.

Bonus Points:

  • Hands-on experience with NGINX/OpenResty/Kong/LuaJIT.
  • Hands-on experience with Envoy or Istio.
  • Hands-on experience with Rust.
  • Hands-on experience leveraging AI agents to deliver intricate software systems efficiently and with superior quality.

#LI-WL1

Kong's standard text

About Kong:

Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit www.konghq.com.

What this role asks for

Particular to this role

Envoy · Generative AI · Rust

Rare in Kong's other 56 open postings.

76% of this description is written for the role. The rest is Kong's standard text, folded away below.

Compared with Kong's other open jobs.

The team: ENG HIRES STEADILY

This role is one of 30 open in ENG. 19 were posted in the last 30 days and the oldest in March: a team that hires all year rather than one being built.

WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS

Kubernetes (21 of 30), Golang (20 of 30), Istio (16 of 30), LLM (15 of 30), AWS (14 of 30), Nginx (14 of 30), Azure (13 of 30)

OTHER ROLES ON THIS TEAM

From the team and dates on Kong's own job board.

Other openings for this role

4 open postings for this role in Shanghai, China, first posted 23 October 2026. The company is likely hiring for more than one position. None has been taken down and posted again.

Similar jobs

More jobs like this

Is this your posting? Email [email protected] to have it removed.