GPU Cluster Engineer, Hardware Operations
- Salary
- $150K - $180K
- Level
- Mid
- Work type
- On-site · San Jose
Not stated in the posting: visa.
Open. First seen 6 November 2026.
About the role
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.
Role Overview
We are looking for a dedicated Hardware Operations Engineer to own the physical health and foundational infrastructure of our GPU clusters. You will be the primary custodian of our compute hardware, responsible for everything from data center vendor coordination up to the base Linux OS layer. You will ensure our research and product teams have a stable, secure, and fully operational physical environment to run their demanding compute workloads on.
Key Responsibilities
- System Health & Hardware Reliability
- On-Call Response: Serve as the primary point of contact for physical system outages, hardware failures, and network interruptions to minimize downtime.
- Cluster Monitoring: Proactively monitor hardware health, including GPU thermals, power draw, and physical system loads, catching anomalies before they impact active workloads.
- Vendor Liaison: Work closely with data center facility staff and third-party hardware vendors to coordinate RMA processes, physical repairs, part replacements, and routine maintenance.
- Hardware Deployment: Rack, cable, and lead the physical bring-up of new GPU nodes, ensuring power and network connectivity are fully integrated into the existing cluster.
- Linux & Network Administration
- OS Management: Install, patch, and maintain Linux operating systems (Ubuntu/CentOS/RHEL) across the cluster bare-metal servers.
- Security & Access: Configure and maintain edge and internal networking, including firewalls, VPNs, and strict SSH access controls to secure our infrastructure.
- Identity & Storage Management: Administer LDAP/Active Directory for centralized user authentication and ensure network storage systems (NFS/GPFS/Lustre) are reliably mounted and properly permissioned.
Qualifications
- Must-Haves:
- 3+ years of experience in Linux Systems Administration (deep knowledge of boot processes, systemd, disk management, etc.).
- Strong background in server hardware troubleshooting, specifically within high-density environments (power, cooling, PCIe topologies).
- Experience managing networking security (VPNs, iptables/firewalld, VLANs) and directory services (LDAP/FreeIPA/Active Directory).
- Proficiency in Bash scripting for essential system automation.
- Nice-to-Haves:
- Experience using configuration management tools like Ansible, SaltStack, or Terraform for OS provisioning.
- Familiarity with data center operations, cooling requirements for high-TDP accelerators (like NVIDIA B200 or AMD MI355x).
Benefits include
- Medical, dental, and vision insurance
- 401k plan
- Daily lunch, snacks, and beverages
- Flexible time off
- Competitive salary and equity
Sciforium's standard text
Equal opportunity
Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
What this role asks for
Particular to this role
Active Directory
Rare in Sciforium's other 23 open postings.
92% of this description is written for the role. The rest is Sciforium's standard text, folded away below.
Compared with Sciforium's other open jobs.
The team: Engineering HIRES STEADILY
This role is one of 24 open in Engineering. 2 were posted in the last 30 days and the oldest in November: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Python (20 of 24), LLM (16 of 24), Machine Learning (16 of 24), CUDA (12 of 24), C++ (10 of 24), Kubernetes (10 of 24), PyTorch (10 of 24)
OTHER ROLES ON THIS TEAM
- GPU Kernel Engineer posted Oct 26
- GPU Kernel Engineer posted Oct 26
- Senior HPC & GPU Infrastructure Engineer posted Oct 6
- Senior HPC & GPU Infrastructure Engineer posted Oct 6
- Foundation Model Data Engineer posted Sep 28
- Foundation Model Data Engineer posted Sep 28
- Pre-training Research Engineer posted Aug 31
- Pre-training Research Engineer posted Aug 31
- Research Engineer - Model Evaluation & MLOps posted Aug 31
- Research Engineer - Model Evaluation & MLOps posted Aug 31
- Distributed Training and Inference Engineer posted Aug 24
- Distributed Training and Inference Engineer posted Aug 24
- Lead Software Engineer, Model Serving Platform posted Aug 17
- Lead Software Engineer, Model Serving Platform posted Aug 17
- Software Engineer, Fullstack posted Aug 7
- Software Engineer, Fullstack posted Aug 7
- GPU Cluster Engineer, Networking posted Aug 6
- GPU Cluster Engineer, Networking posted Aug 6
- GPU Cluster Engineer, Systems & Platform posted Aug 6
- GPU Cluster Engineer, Systems & Platform posted Aug 6
- GPU Cluster Engineer, Hardware Operations posted Jul 8
- Senior AI Serving Engineer, Backend posted Nov 15
- Senior AI Serving Engineer, Backend posted Nov 15
From the team and dates on Sciforium's own job board.
Other openings for this role
2 open postings for this role in San Jose, CA, first posted 2 October 2026. The company is likely hiring for more than one position. None has been taken down and posted again.
- 6 November 2026 – open (this posting)
- 2 October 2026 – open
Similar jobs
- Systems Engineer at Geneva Trading
Shares 5 skills: Active Directory, Ansible, Bash… · same seniority · same country - Systems Engineer at Leidos
Shares 5 skills: Active Directory, Ansible, Bash… · same seniority · same country - IT Operations Engineer at Applied Intuition
Shares 3 skills: Active Directory, Bash, Linux · same seniority · same country - System Engineer at Anduril Industries
Shares 5 skills: Active Directory, Ansible, Bash… · same country - Senior IT Support Specialist at Hermeus
Shares 4 skills: Active Directory, Ansible, Bash… · same country - Pre-training Research Engineer at Sciforium
Also at this company
More jobs like this
Is this your posting? Email info@careerholo.com to have it removed.