Staff Software Engineer, Observability
- Level
- Staff
- Work type
- Hybrid · Sunnyvale
Not stated in the posting: salary, visa.
Open. First seen 28 October 2026.
About the role
Cerebras Systems's standard text
Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.
This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.
Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.
Responsibilities
- Set Technical Direction: Own the long-term architecture and roadmap for the observability platform across all pillars (metrics, logs, traces, and events). Drive adoption across the engineering organization through RFCs, design reviews, and close partnership with stakeholders.
- Build for Cerebras-Scale: Design telemetry pipelines that handle high-cardinality, high-frequency data from thousands of Wafer-Scale Engines, large Kubernetes clusters, and the storage and networking fabric connecting them. Solve ingestion and query performance problems that break conventional approaches.
- Drive Reliability Across the Organization: Partner with Engineering, SRE, Hardware, and ML Infrastructure teams to define SLOs, build alerting strategies, and create tooling that accelerates root cause analysis and reduces MTTR. Make it easy for any engineer to understand system health and diagnose failures.
- Bridge Hardware and Software Observability: Work with engineering teams accross the stack to surface critical hardware health signals into a unified observability layer alongside software metrics.
- Shape Developer Experience: Design and implement instrumentation libraries and standards (OpenTelemetry) that make rich observability the default for every service, not an afterthought. Establish conventions that scale across teams.
- Mentor and Grow Engineers: Raise the technical bar across the organization. Mentor senior engineers, influence engineering practices across team boundaries, and foster a culture of operational excellence.
Qualifications
- 8+ years of software engineering experience, with 4+ years building or operating observability/monitoring platforms at significant scale (millions of active time series, petabytes of log data).
- Deep expertise in the open-source observability ecosystem. You have operated, tuned, and extended systems like Prometheus, Thanos/Cortex/Mimir, Elasticsearch/ClickHouse, or Loki and understand their internals, failure modes, and cost characteristics.
- Experience with OpenTelemetry for instrumentation across a polyglot services environment.
- Proficiency in Go preferred, with strong experience in Python. You write performant, concurrent systems code, not just glue scripts.
- Strong distributed systems and Kubernetes expertise: sharding, replication, consistency models, monitoring K8s itself and the workloads running on it, and the tradeoffs involved in building reliable data pipelines at scale.
- Experience with observability cost management and capacity planning at scale.
- Track record of setting technical direction and driving adoption across multiple teams. You operate effectively with ambiguity and can translate business needs into technical strategy.
Cerebras Systems's standard text
Why Join Cerebras
People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:
- Build a breakthrough AI platform beyond the constraints of the GPU.
- Publish and open source their cutting-edge AI research.
- Work on one of the fastest AI supercomputers in the world.
- Enjoy job stability with startup vitality.
- Our simple, non-corporate work culture that respects individual beliefs.
Find out more about what it's like to work at Cerebras here!
Apply today and become part of the forefront of groundbreaking advancements in AI!
Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.
This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.
What this role asks for
Particular to this role
ClickHouse · Elasticsearch · OpenTelemetry · Prometheus
Rare in Cerebras Systems's other 108 open postings.
Standard for DevOps / SRE / cloud roles
Golang · Kubernetes
Common in DevOps / SRE / cloud postings at any company.
In most of Cerebras Systems's ads
Python
Named in most of its open postings, whatever the role.
53% of this description is written for the role. The rest is Cerebras Systems's standard text, folded away below.
Compared with Cerebras Systems's other open jobs.
The team: Inference Service HIRES STEADILY
This role is one of 13 open in Inference Service. 4 were posted in the last 30 days and the oldest in July: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
C++ (10 of 13), Kubernetes (10 of 13), Golang (9 of 13), Machine Learning (8 of 13), Python (8 of 13), CI/CD (7 of 13), LLM (7 of 13)
OTHER ROLES ON THIS TEAM
- Senior Software Engineer, ML API – AI Inference posted Oct 27
- Senior Backend Engineer, Inference Cloud posted Oct 22
- Staff Software Engineer, GPU Inference posted Oct 21
- Engineering Manager, Inference Router posted Oct 13
- Staff Software Engineer, Inference API posted Sep 23
- Senior SDET, Inference Platform posted Jul 13
- Cloud Quality Engineer posted Jul 2
- Senior Inference ML API SDET posted Jun 29
- Software Engineer, Inference Platform posted Jun 20
- Staff Software Engineer, Inference Platform posted Jun 19
- Software Engineer, GPU Inference posted Nov 25
- Senior Software Engineer, Inference Cloud posted Jul 12
From the team and dates on Cerebras Systems's own job board.
Similar jobs
- Senior Software Engineer II, Observability at CoreWeave
Shares 7 skills: ClickHouse, OpenTelemetry, Elasticsearch… · same city - Senior Software Engineer, Observability at Airwallex
Shares 7 skills: ClickHouse, OpenTelemetry, Elasticsearch… · same country - Staff Software Engineer, Observability/Site Reliability at PsiQuantum
Shares 6 skills: ClickHouse, OpenTelemetry, Prometheus… · Staff level · same country - Principal Observability Platform Engineer at Nscale
Shares 6 skills: ClickHouse, OpenTelemetry, Prometheus… · Staff level · same country - Sr. Observability Systems Engineer at Backblaze External Website
Shares 6 skills: OpenTelemetry, Elasticsearch, Prometheus… · same country - Hardware Lab Manager at Cerebras Systems
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.