Software Engineer, Inference
- Salary
- $150K - $230K
- Level
- Mid
- Work type
- On-site · San Francisco
- Visa
- Sponsors visas
Open. First seen 14 March 2026.
About the role
Overview
Pulse is tackling one of the most persistent challenges in data infrastructure: extracting accurate, structured information from complex documents at scale. We have a breakthrough approach to document understanding that combines intelligent schema mapping with fine-tuned extraction models where legacy OCR and other parsing tools consistently fail.
We are a small, fast-growing team of engineers in San Francisco powering Fortune 100 enterprises, YC startups, public investment firms, and growth-stage companies. We are backed by tier 1 investors and growing quickly.
What makes our tech special is our multi-stage architecture:
- Layout understanding with specialized component detection models
- Low-latency OCR models for targeted extraction
- Advanced reading-order algorithms for complex structures
- Proprietary table structure recognition and parsing
- Fine-tuned vision-language models for charts, tables, and figures
If you are passionate about the intersection of computer vision, NLP, and data infrastructure, your work at Pulse will directly impact customers and shape the future of document intelligence.
What we are looking for
- 5 days in-office at our San Francisco office
- Eager to learn and adapt quickly
- Prior startup or founding experience is a plus
What we are looking for
- 5 days in-office at our San Francisco office
- Eager to learn and adapt quickly
- Prior startup or founding experience is a plus
About the Role
Specialize in low-latency, high-throughput inference for OCR and multimodal models. Own profiling, batching, and autoscaling across single-tenant and multi-tenant environments.
Responsibilities
- Build inference services with smart batching and caching
- Optimize kernels, tokenization, and model graphs
- Evaluate vLLM, TensorRT LLM, and Triton tradeoffs
- Implement autoscaling and admission control with clear SLOs
- Own performance dashboards and capacity planning
Requirements
- 3+ years in performance engineering or ML systems
- Strong Python, plus C++ or CUDA exposure
- Experience with GPU profiling and model serving
Nice to have
- Experience reducing p95 and cost in production ML systems
Sponsorship
Sponsorship available.
Compensation and benefits
Competitive base salary plus equity, performance-based bonus, relocation assistance for Bay Area moves, daily meal stipend, medical, vision, and dental coverage.
The team: Engineering
This role is one of 6 open in Engineering.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Computer Vision (6 of 6), NLP (6 of 6), AWS (3 of 6), Machine Learning (3 of 6), Python (3 of 6), Kubernetes (2 of 6), React (2 of 6)
OTHER ROLES ON THIS TEAM
- Design Engineer posted Jul 30
- DevOps Engineer posted Jul 30
- Machine Learning Engineer posted Jul 30
- Software Engineer posted Jul 30
- Forward Deployed Engineer posted Jul 30
From the team and dates on Pulse's own job board.
See Software Engineer salaries in San Francisco →
Similar jobs
- Large Language Model Inference System Engineer Graduate (Applied Machine Learning) - 2027 Start at ByteDance
Shares 6 skills: CUDA, NLP, Computer Vision… · same country - (Senior) Software Engineer, Deep Learning at pony.ai
Shares 6 skills: CUDA, NLP, C++… · same country - ML Research Scientist - Inference ML at Cerebras Systems
Shares 6 skills: CUDA, NLP, Computer Vision… · same seniority - AI Engineer at Armada
Shares 6 skills: CUDA, NLP, Computer Vision… · same seniority · same country - Machine Learning Engineer III at Peloton
Shares 6 skills: NLP, Computer Vision, C++… · same country - Solutions Engineer at Pulse
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.