AI Runtime Engineer
- Level
- Mid
Not stated in the posting: salary, work type, visa.
Open. First seen 2 October 2026.
About the role
EnCharge AI's standard text
EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge’s robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today’s best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications.
EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems.
About the Role
EnCharge AI is seeking an AI Runtime Engineer to develop and optimize the execution stack for our next-generation AI accelerator. In this role, you will work on low-latency, high-performance runtime software that enables efficient execution of deep learning models on specialized hardware. You will collaborate with hardware, compiler, and AI framework teams to deliver optimized AI inference and training performance across cloud and edge environments.
Responsibilities
- Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators.
- Implement task scheduling, memory management, and kernel execution strategies for efficient computation.
- Optimize data movement between host and device using PCIe, DMA, shared memory.
- Design and implement high-performance APIs for AI Inference frameworks such as OpenVino, ONNX Runtime, vLLM
- Work on graph execution optimizations, including kernel fusion, pipelining, tensor tiling, and caching.
- Integrate runtime components with AI compilers (LLVM, MLIR, XLA, TVM) for optimized execution.
- Ensure scalability and reliability of the AI runtime for cloud-based and edge AI deployments.
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
- 3+ years of experience in developing low-level runtime software for AI accelerators, GPUs, or HPC systems.
- Strong proficiency in C/C++ and low-level systems programming.
- Deep understanding of task scheduling, concurrency, and memory hierarchy.
- Experience with hardware-aware optimizations and dataflow architectures.
- Familiarity with deep learning execution frameworks (ONNX Runtime, TensorRT, TVM, OpenVINO).
- Experience with low-latency, high-throughput workload execution for AI models.
- Strong debugging and profiling skills for optimizing AI execution performance.
- Exposure to AI model deployment pipelines (Triton, TensorFlow Serving).
EnchargeAI is an equal employment opportunity employer in the United States.
What this role asks for
Particular to this role
Deep Learning · TensorFlow
Rare in EnCharge AI's other 23 open postings.
77% of this description is written for the role. The rest is EnCharge AI's standard text, folded away below.
Compared with EnCharge AI's other open jobs.
The team: Software
This role is one of 7 open in Software.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
C++ (6 of 7), C (3 of 7), Deep Learning (3 of 7), Embedded Systems (3 of 7), Linux Kernel (3 of 7), Python (3 of 7), TensorFlow (3 of 7)
OTHER ROLES ON THIS TEAM
- AI Software Engineer, Agent Harness posted Sep 16
- Technical Program Manager - Embedded Software posted Aug 20
- AI Compiler Engineer posted Jun 9
- Device Driver Engineer posted Jul 10
- Embedded SW Engineer posted Jul 10
- AI Compiler Engineer posted Jul 10
From the team and dates on EnCharge AI's own job board.
Similar jobs
- Video/Image AI/ML Software Engineer Graduate (Multimedia) - 2027 Start (PhD) at ByteDance
Shares 4 skills: TensorFlow, Deep Learning, C… - AI Engineer at Capco
Shares 3 skills: TensorFlow, Deep Learning, C++ · same seniority - R&D – Mobile AI SW Engineer at Qualcomm
Shares 3 skills: TensorFlow, C, C++ · same seniority - ML Research Engineer at Microsoft
Shares 4 skills: TensorFlow, Deep Learning, C… · same seniority - Edge AI Engineer (Mid/Senior) | Telematics at Teltonika
Shares 3 skills: TensorFlow, C, C++ - SoC Clocking Specialist (Physical Design) at EnCharge AI
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.