Principal Architect, Performance Analysis and Modeling
- Salary
- $195K - $285K
- Level
- Principal
- Work type
- Hybrid · Santa Clara
Not stated in the posting: visa.
Open. First seen 6 November 2026.
About the role
d-Matrix's standard text
Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today. If you want to create what comes next and help make infinite inference possible, we’d love to hear from you.
Our culture is built on respect, collaboration, and direct communication. We value humility, we believe our different perspectives lead to better solutions, and we’re looking for people who are driven by execution and energized by hard problems.
Working onsite at our Santa Clara, CA headquarters 3 days per week hybrid. Will consider remote in the United States.
The role: Principal Architect, Performance Analysis and Modeling
d-Matrix is seeking outstanding computer architects to help accelerate AI application performance at the intersection of both hardware and software, with particular focus on emerging hardware technologies (such as DIMC, D2D, 3D-DRAM, etc.) and emerging workloads (such as generative inference, etc.). Our acceleration philosophy cuts through the system, ranging from efficient tensor cores, storage, and data movements along with co-design of dataflow and collective communication techniques.
What you will do:
- As a member of the architecture team, you will analyze the latest ML workloads (multi-modal LLMs, CoT reasoning models, video/audio generation)
- You will contribute hardware and software features that power the next generation of inference accelerators in datacenters
- This role requires keeping up with the latest research in ML architecture and algorithms and collaborating with different partner teams, including Product, Hardware Design, Compiler, Inference Server, and Kernels
- Your day-to-day work will include (1) analyzing the properties of emerging machine learning algorithms and workloads and identifying functional, performance implications (2) Creating analytical models to project performance on current and future generations of d-matrix hardware (3) proposing new HW/SW features to enable or accelerate these algorithms
What you will bring:
Minimum:
- BSEE with 10+ years of industry experience or MSEE preferred with 8+ years of industry experience
- Solid grasp through academic or industry experience in multiple of the relevant areas, computer architecture, hardware-software codesign, performance modeling, ML fundamentals (particularly DNNs)
- Programming fluency in C/C++ or Python
- Experience with developing analytical performance models, architecture simulators for performance analysis
- Research background with publication record in top-tier architecture, or machine learning venues is a huge plus (such as ISCA, MICRO, ASPLOS, HPCA, DAC, MLSys etc.)
- Self-motivated team player with strong sense of collaboration and initiative
d-Matrix's standard text
Equal Opportunity Employment Policy
d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication, and a willingness to embrace challenges and learn together every day.
d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individuals interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of all applicants. Thank you for your understanding and cooperation.
What this role asks for
In most of d-Matrix's ads
Python
Named in most of its open postings, whatever the role.
54% of this description is written for the role. The rest is d-Matrix's standard text, folded away below.
Compared with d-Matrix's other open jobs.
The team: Architecture
This role is one of 6 open in Architecture.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
LLM (6 of 6), Python (6 of 6), C (4 of 6), C++ (4 of 6), Generative AI (4 of 6), Machine Learning (4 of 6), CUDA (2 of 6)
OTHER ROLES ON THIS TEAM
- Senior Staff LLM Inference Engineer posted Aug 18
- Senior Staff LLM Inference Engineer posted Aug 18
- Sr. Staff ML Researcher, LLM Algorithmic Optimization posted Jul 15
- Sr. Staff ML Researcher, LLM Algorithmic Optimization posted Jul 15
- Principal Architect, Performance Analysis and Modeling posted Mar 11
From the team and dates on d-Matrix's own job board.
Other openings for this role
2 open postings for this role in Santa Clara, first posted 2 October 2026. The company is likely hiring for more than one position. None has been taken down and posted again.
- 6 November 2026 – open (this posting)
- 2 October 2026 – open
Similar jobs
- Staff Security Engineer at Jellyfish
Shares 5 skills: C, C++, LLM… · Staff level · same country - Principal Software Engineer at Microsoft
Shares 5 skills: C, C++, LLM… · Staff level · same country - System Performance Engineer, Senior at Qualcomm
Shares 4 skills: C, C++, LLM… · same country - Memory Architect at Normal Computing Corporation
Shares 4 skills: C, C++, Machine Learning… · same country - R&D Software Engineer at webAI
Shares 5 skills: C, C++, LLM… · same country - Staff Quality Automation Engineer at d-Matrix
Also at this company
More jobs like this
Is this your posting? Email info@careerholo.com to have it removed.