Software Engineer - ML Infrastructure
- Level
- Mid
- Work type
- On-site · San Francisco
Not stated in the posting: salary, visa.
Open. First seen 2 October 2026.
About the role
Specter's standard text
Company Background
Specter's mission is to help automate the physical world.
Today, we build video sensors with state-of-the-art AI agents that answer any question, anywhere in their environments. Our systems can automatically detect and reason about any physical activity captured on camera, from security incidents (e.g. perimeter intrusion, theft, LPR), to safety monitoring (e.g. PPE detection, injured people), to operational efficiency (e.g. material tracking, congestion monitoring). We offer both long range wireless (1km range) and wired sensor variants to suit any deployment.
Our co-founders Xerxes and Philip are passionate about empowering our partners in the fast approaching world of physical AI and robotics. We are a small, fast growing team who hail from Anduril, Tesla, Uber, and the U.S. Special Forces.
The Role
Specter is hiring an ML Infrastructure engineer to build and scale the machine learning systems that power real-time perception and inference across our edge-cloud platform. This role owns the data, training, deployment, and serving infrastructure for the computer vision and VLM systems that enable autonomous monitoring and orchestration across our customers' physical assets.
Responsibilities:
- Designing and implementing scalable ML training and inference pipelines for perception models (object detection, tracking, classification, segmentation) and VLMs.
- Developing continuous training and evaluation systems to improve model performance from production data feedback loops.
- Designing large-scale multi-modal data pipelines for ingesting, processing, and indexing video and sensor data spanning both batch and streaming workloads.
- Creating data pipelines for ingesting, labeling, versioning, and managing massive multi-modal sensor datasets (video, radar, lidar, thermal).
- Implementing model monitoring, A/B testing frameworks, and performance analytics for deployed perception systems.
- Collaborating with perception researchers to transition models from research to production at scale across thousands of edge nodes.
- Building tools and infrastructure for distributed training, hyperparameter optimization, and experiment tracking.
Qualifications:
- Strong software engineering fundamentals in Python, with working proficiency in a systems language (Rust, Go, C++) for performance-sensitive data and inference paths.
- Working proficiency with ML frameworks (PyTorch, TensorFlow) and model optimization tooling.
- Deep experience building and operating model inference systems at scale, request routing, batching, autoscaling, caching, and latency/throughput tuning under real production load.
- Hands-on experience with distributed compute frameworks for ML and data workloads (Ray, Spark, or equivalent), including GPU cluster management and orchestration.
- Strong understanding of distributed systems fundamentals: partitioning, replication, backpressure, exactly-once semantics.
- Experience with vector databases (QDrant, LanceDB, or equivalent) for similarity search and retrieval workloads.
- Familiarity with LLM/VLM serving frameworks (VLLM, SGLang, TensorRT-LLM) in production is a strong plus.
- Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus.
What this role asks for
Particular to this role
TensorFlow · Vector Databases
Rare in Specter's other 29 open postings.
Standard for data science / ML roles
LLM · Machine Learning · PyTorch · Python
Common in data science / ML postings at any company.
71% of this description is written for the role. The rest is Specter's standard text, folded away below.
Compared with Specter's other open jobs.
The team: Engineering
This role is one of 15 open in Engineering.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Python (12 of 15), Embedded Systems (9 of 15), Computer Vision (8 of 15), Rust (8 of 15), Linux (7 of 15), Golang (6 of 15), C (5 of 15)
OTHER ROLES ON THIS TEAM
- Optics & Camera Engineering Lead posted Oct 16
- CV/ML Camera Test Engineer posted Oct 15
- Software Engineer - Applied AI posted Aug 28
- Software Engineer — Fleet posted Aug 24
- Platform Site Reliability Engineer posted Aug 20
- Fleet Reliability Engineer posted Jul 13
- Site Reliability Engineer posted Jul 2
- Data Operations Engineer posted May 20
- Software Engineer - Test Automation posted Mar 31
- Software Engineer - Embedded Systems posted Jan 23
- Software Engineer - Full Stack posted Jan 13
- Software Engineer - Systems posted Oct 3
- Software Engineer - Backend posted Oct 3
- ML Research Engineer posted Oct 3
From the team and dates on Specter's own job board.
See Software Engineer salaries in San Francisco →
Similar jobs
- Video/Image AI/ML Software Engineer Graduate (Multimedia) - 2027 Start (PhD) at ByteDance
Shares 6 skills: TensorFlow, PyTorch, C++… · same country - Founding Engineer (AI/ML) at Clera
Shares 6 skills: TensorFlow, Vector Databases, PyTorch… · same seniority · same city · ✓ Visa sponsorship - Software Engineer at GRVTY
Shares 6 skills: TensorFlow, Vector Databases, PyTorch… · same seniority · same country - Applied ML Engineer, Care Experience at Bask Health
Shares 6 skills: TensorFlow, Vector Databases, PyTorch… · same seniority · same country - Robotics Machine Learning Engineer at Persona AI
Shares 7 skills: TensorFlow, PyTorch, Rust… · same seniority · same country - Optics & Camera Engineering Lead at Specter
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.