Principal Technical Program Manager (TPM) - AI Infrastructure Operations
- Level
- Principal
Not stated in the posting: salary, work type, visa.
Open. First seen 2 October 2026.
About the role
Role Overview
As a Technical Program Manager (TPM) for AI Infrastructure Operations, you will be the operational backbone of our high-scale, high-performance AI and High-Performance Computing (HPC) environment. You will be responsible for driving complex, cross-functional programs that ensure the stability, availability, and growth of our cutting-edge GPU fleet and Infiniband network fabrics. This role requires a blend of deep technical understanding, rigorous program management, and a relentless focus on delivering against key operational metrics (SLAs, Uptime, Availability).
You will bridge the gap between engineering execution and strategic business goals, directly impacting our ability to serve customer workloads at scale.
Key Responsibilities
- Program Leadership: Own the planning, execution, and delivery of strategic operational programs, including new data center AI infrastructure build-outs, large-scale fleet software/firmware rollouts, and the implementation of new operational tooling (in partnership with SRE).
- Metrics and Reporting: Establish, track, and drive accountability against critical infrastructure KPIs, specifically focusing on Availability (Target 97.5%) and Uptime (Target 99%). Develop clear dashboards and communication rhythms to provide leadership with real-time visibility into operational health, program status, and risk.
- Process Engineering: Analyze and optimize operational workflows across Fleet Operations, Network Operations, and SRE teams. Drive the standardization of incident management, change management, and postmortem processes to reduce toil and improve Mean Time to Recovery (MTTR).
- Cross-Functional Coordination: Serve as the primary liaison between engineering teams (Hardware, Compute Platform, Network), Data Center Operations, and external vendors (GPU, Network hardware). Proactively identify and resolve dependencies, risks, and roadblocks.
- Capacity and Readiness: Partner with Data Science/Operation Programs to translate capacity planning models into actionable infrastructure delivery and readiness roadmaps. Ensure that new hardware (GPUs, NICs, switches) is successfully integrated into the operational control plane and meets go-live criteria.
- Risk Management: Proactively identify technical, schedule, and resource risks related to AI infrastructure scaling and stability. Develop mitigation strategies and communicate impacts clearly to stakeholders.
Required Qualifications
- Experience: 5+ years of experience in a Technical Program Management role, successfully driving large-scale, complex infrastructure or software engineering programs.
- Technical Domain Knowledge: Strong foundational understanding of data center infrastructure, distributed systems, Linux, and networking concepts.
- Program Management Rigor: Proven expertise in modern program management methodologies (Agile, Scrum, PMP certification preferred). Exceptional organizational, communication, and presentation skills.
- Metrics-Driven Approach: Demonstrable experience in defining, tracking, and improving system performance based on operational metrics (e.g., Uptime, Availability, MTTR, SLOs/SLIs).
- Execution in Ambiguity: Ability to thrive in a fast-paced, high-growth environment, managing multiple priorities and adapting to evolving technical requirements.
Preferred Qualifications
- Direct experience managing programs related to data center infrastructure build-outs and hardware commissioning processes.
- Specific domain knowledge of AI/HPC infrastructure, including NVIDIA GPUs, InfiniBand/RDMA networks, and the challenges of tightly-coupled systems.
- Experience in a hyperscale or public cloud environment supporting 24/7 mission-critical services.
- Familiarity with SRE principles, automation tooling, and continuous integration/continuous deployment (CI/CD) pipelines for infrastructure.
- A Bachelor's or Master's degree in a technical field (Computer Science, Engineering, etc.) or equivalent practical experience.
What We Can Offer You
At Nscale, you'll find a collaborative, supportive, and innovative environment where your contributions spark real impact. We're building something extraordinary, and we want you at the core.
- Highly competitive package (base + equity) with reviews every 12 months.
- Join the fastest-growing tech startup, your chance to push boundaries, collaborate with brilliant minds, and make your mark on cutting-edge AI.
- Expect a dynamic progression plan tailored to your ambitions. Grow by trying new things, leading, challenging the status quo, and owning your impact, always with our full support.
Nscale's standard text
For information on how Nscale handles candidate personal data, please see our Employee & Candidate Privacy Notice: Here.
Nscale does not accept unsolicited candidate submissions from recruitment agencies.
What this role asks for
95% of this description is written for the role. The rest is Nscale's standard text, folded away below.
Compared with Nscale's other open jobs.
The team: AI Infra Operations HIRES STEADILY
This role is one of 31 open in AI Infra Operations. 7 were posted in the last 30 days and the oldest in April: a team that hires all year rather than one being built.
WHAT THE TEAM WORKS WITH, ACROSS ITS POSTINGS
Python (22 of 31), Ansible (15 of 31), Networking (15 of 31), Kubernetes (13 of 31), Linux (11 of 31), Embedded Systems (10 of 31), Golang (9 of 31)
OTHER ROLES ON THIS TEAM
- Network Front-End Engineer posted Nov 11
- AI Reliability Engineering Manager posted Nov 10
- Developer Experience Engineer-AI Infrastructure Operations posted Nov 3
- Senior Developer Experience Engineer-AI Infrastructure Operations posted Nov 3
- Principal Front-End Network Engineer posted Oct 30
- Data Center Operations Implementation Manager posted Oct 29
- Senior Infrastructure Operations Engineer (Glomfjord) posted Oct 29
- Staff Front-End Network Engineer posted Oct 16
- Sr. Data Center Operations posted Oct 15
- Principal Observability Platform Engineer posted Oct 9
- Senior Infrastructure Operations Engineer (Portugal) posted Oct 9
- Infrastructure Operations Engineer (Glomfjord) posted Oct 9
- Infrastructure Operations Engineer (Stavanger) posted Oct 8
- Centre of Excellence Senior Engineer posted Oct 2
- AI Reliability Engineer I - APAC (FLR) posted Sep 25
- Principal Network Engineer posted Sep 14
- Site Reliability Engineer posted Sep 8
- Principal Infrastructure Engineer, AI Cluster Performance & Validation posted Sep 3
- Senior Network Engineer posted Aug 31
- Senior Observability Platform Engineer posted Aug 21
- Principal Network Engineer posted Aug 10
- Infrastructure IT Operations Engineer (Batam) posted Jul 22
- Infrastructure Operations Engineer (Narvik) posted Jul 16
- AI Reliability Engineer I - APAC posted Jun 22
- AI Reliability Engineer II - APAC posted Jun 22
- Staff Observability Platform Engineer posted Jun 9
- Senior Principal Front-End Network Engineer, AI Infrastructure Operations posted Jun 2
- Senior Front-End Network Engineer, AI Infrastructure Operations posted Jun 2
- Principal Site Reliability Engineer, Infrastructure Architecture- AI Infrastructure Operations posted Apr 3
- Senior Site Reliability Engineer -AI Infrastructure Operations posted Apr 3
From the team and dates on Nscale's own job board.
See Technical Program Manager salaries in the United States →
Similar jobs
- Staff Technical Program Manager, Robot Software at Apptronik
Shares 3 skills: Embedded Systems, Linux, CI/CD · Staff level · same country - Senior Hardware Technical Program Manager (TPM) – Storage at CoreWeave
Shares 2 skills: Embedded Systems, Agile · same country - Senior Staff Infrastructure Engineer at Samsung Semiconductor
Shares 3 skills: Embedded Systems, Linux, CI/CD · Staff level · same country - Critical Environment Platform Operations Manager at Microsoft
Shares 3 skills: Embedded Systems, Linux, CI/CD · same country - Senior Device Reliability Engineer (AI Native) at Life360
Shares 3 skills: Embedded Systems, Agile, CI/CD · same country - Principal Site Reliability Engineer, Infrastructure Architecture- AI Infrastructure Operations at Nscale
Also at this company
More jobs like this
Is this your posting? Email [email protected] to have it removed.