---
title: Director Site Reliability Engineer, AI Infrastructure
description: d-Matrix is hiring for the Director Site Reliability Engineer, AI Infrastructure
  role in Santa Clara, CA. See the full description and apply.
type: job
url: https://www.foundrole.com/jobs/director-site-reliability-engineer-ai-infrastructure-at-d-matrix-01a0df47-ef98-7dc4-8cce-311a1fc2a90d
date: 2026-11-15T01:26:44Z
og_description: Join d-Matrix as Director Site Reliability Engineer, AI Infrastructure in Santa
  Clara, CA. Pays $195K–$285K per year.
og_image: https://www.foundrole.com/og/lirpya.png
breadcrumbs:
  - label: Home
    url: https://www.foundrole.com/
  - label: Search
    url: https://www.foundrole.com/jobs
---

| | |
|---|---|
| **Company** | d-Matrix |
| **Location** | Santa Clara, CA (Hybrid) |
| **Salary** | $195K/yr - $285K/yr |
| **Type** | Full Time |
| **Posted** | Sep 26, 2026 |
| **History** | First seen 49 days ago (2026-09-26), reposted once |

## Is this job real?

**Ghost job check:** B · Low risk. Probably a real opening.

## Visa sponsorship

- **H-1B:** d-Matrix sponsors H-1B visas. It filed 27 H-1B petitions (FY2026 Q1 – FY2026 Q4).
- **E-Verify:** No E-Verify enrollment on record for d-Matrix.

## Pay for similar jobs

Most similar jobs pay $386,000 – $416,000 a year (median $404,000).

## Description

Join d-Matrix and help build the future of AI inference. We’ve pioneered a memory-centric architecture that brings compute directly into memory, making AI faster, more energy efficient, and accessible on a global scale. From chips and software to rack-scale systems, our team is tackling some of AI infrastructure’s hardest challenges — and shipping breakthrough technology today. If you want to create what comes next and help make infinite inference possible, we’d love to hear from you.

Our culture is built on respect, collaboration, and direct communication. We value humility, we believe our different perspectives lead to better solutions, and we’re looking for people who are driven by execution and energized by hard problems.

### Role Overview

d-Matrix designs and manufactures purpose-built AI inference silicon, and the infrastructure behind our engineering organization must be as reliable and scalable as the chips we build. This role builds and leads d-Matrix’s Site Reliability Engineering (SRE) function from the ground up. You will own the infrastructure that development, validation, and customer-facing deployments run on, spanning colocation facilities, on-premises lab clusters, cloud environments (AWS, Azure, GCP), and platform services. You will hire and grow the team, set technical direction, own SLOs for critical systems, and serve as the senior escalation point for incidents, while staying hands-on. You will partner closely with Software Tools, QA DevOps, Engineering, Networking Operations, and IT Operations to improve reliability, cost efficiency, and technical debt.

### What You Will Do

- Build and lead the SRE function from scratch: define its charter, establish SRE as a discipline across hardware and software engineering, and hire, develop, and retain a team of 1–3 SRE engineers.

- Lead the Data Center & Lab Technician team, setting priorities and operational standards across on-premises and colocation facilities.

- Own 24×7 reliability across colocation, on-premises lab clusters, cloud, and customer-facing platform services, designing for failure domains, progressive delivery, and strict change control.

- Establish SRE processes: define SLIs, SLOs, and error budgets, design on-call rotations (including a follow-the-sun model as d-Matrix expands globally), and build the incident and root cause analysis (RCA) framework.

- Own the observability stack (Prometheus, Grafana, Datadog, Splunk, or equivalent), instrumenting metrics, traces, and logs for SLO visibility and alert design.

- Drive IaC-first automation (Terraform, Ansible) and build self-healing infrastructure, including host lifecycle automation, fleet auto-remediation, and AIOps-driven alerting.

- Own FinOps and capacity planning across cloud, colocation, and on-premises environments, including spend attribution, TCO modeling, and workload placement decisions.

- Lead the migration from ad-hoc JBOD storage to an enterprise-grade shared storage platform across on-prem, colocation, and cloud, including architecture, vendor selection, and disaster recovery design.

### What You Will Bring

- Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.

- 15+ years in SRE, infrastructure engineering, or production engineering.

- 5+ years leading SRE or infrastructure engineering teams, including experience building or significantly rebuilding a function rather than managing a steady-state team.

- Track record of establishing SRE as a discipline in an organization that lacked it: defining SLOs, creating on-call frameworks, standing up observability, and driving cultural change with teams from a reactive ops background.

- Deep Linux systems expertise, including bare-metal operations and enterprise shared storage (NAS/SAN, NFS/SMB at scale, snapshot and replication architectures), plus hybrid-cloud storage integration.

- Experience operating colocation and on-premises hardware at scale, including server lifecycle, power and cooling awareness, and rack-level networking.

- Hands-on production experience with Infrastructure as Code (Terraform, Ansible), including module design, remote state, environment isolation, and change governance.

- Experience with Kubernetes cluster operations, including lifecycle management, workload reliability, storage, and RBAC at scale.

- Experience owning an observability stack (Prometheus, Grafana, Datadog, Splunk, or equivalent) for SLO definition, alert design, and signal quality.

- Strong Python and/or Go skills for production services and automation that safely touches real infrastructure.

- Ability to communicate infrastructure health and operational risk clearly to senior leadership and non-technical stakeholders.

- Comfort operating in a high-ambiguity, low-process environment, building structure rather than inheriting it.

### Preferred Qualifications

- Experience operating customer-facing infrastructure or platform services with reliability expectations beyond internal tooling.

- Knowledge of high-speed interconnect fabrics such as InfiniBand, RoCE, or NVLink, including setup, troubleshooting, and performance tuning.

- Experience with HPC job schedulers (Slurm, LSF, or equivalent), including setup, tuning, and integration with infrastructure automation.

- Multi-cloud hybrid operations across AWS, Azure, and GCP alongside on-prem and colo, with unified observability and IaC.

- FinOps expertise, including cloud spend attribution, TCO modeling across cloud, on-prem, and colo, and translating cost data into workload placement recommendations.

- Familiarity with ITIL or an equivalent structured incident, problem, and change management framework.

- Published technical writing, conference talks, or open-source contributions in reliability, observability, or HPC infrastructure.

**Equal Opportunity Employment Policy**

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication, and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individuals interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of all applicants. Thank you for your understanding and cooperation.
## Skills

- Capacity Planning
- High-Performance Computing
- Cloud Computing
- Data Replication
- Open Web Application Security Project (Owasp)
- DevOps
- Progressive Delivery
- Amazon Web Services
- Interconnect Design
- Go
- Slurm Workload Manager
- Vendor Selection
- Open-Source Software
- Infrastructure as Code (IaC)
- Splunk
- InfiniBand
- Grafana
- Python
- IT Operations
- Technical Direction
- Service Level Indicators (Sli)
- Cloud Storage
- Observability
- Automation
- ITIL
- Root Cause Analysis
- Role-Based Access Control (Rbac)
- Performance Tuning
- Service Level Objectives
- Technical Writing
- Microsoft Azure
- Data Centers
- Distributed Tracing
- Self-Healing Systems
- Colocation (Data Center)
- Terraform
- IBM Platform LSF
- Kubernetes
- Lifecycle Management
- Multi-Cloud
- Network File Systems
- IT Infrastructure
- Ansible
- On-Premises Infrastructure
- Follow-the-Sun Support
- AI Inference
- Datadog
- Change Control
- Prometheus
- Site Reliability Engineering
- Google Cloud Platform (Gcp)
- Operational Risk
- Leadership
- Cloud Financial Management (FinOps)
- Computer Science
- NVLink
- AIOps
- Linux
- Electrical Engineering
- On-Call Coverage
- Disaster Recovery
- Error Budget Management
- Change Management
- Governance
- Bare Metal
- Site Reliability Engineering (Sre)

## Related

- [Engineering jobs](https://www.foundrole.com/careers/engineering?utm_source=ai_markdown)- [Engineering Manager jobs](https://www.foundrole.com/careers/engineering/engineering-managers?utm_source=ai_markdown)- [Director of Engineering jobs](https://www.foundrole.com/careers/engineering/engineering-managers/director-of-engineering?utm_source=ai_markdown)- [Browse all companies](https://www.foundrole.com/companies?utm_source=ai_markdown)

## Explore this job market

- [California](https://www.foundrole.com/locations/us/california?utm_source=ai_markdown) — 260759 jobs
- [Computer Hardware](https://www.foundrole.com/sectors/technology/computer-hardware?utm_source=ai_markdown) — 22574 jobs
- [Santa Clara, CA](https://www.foundrole.com/locations/us/california/santa-clara?utm_source=ai_markdown) — 6822 jobs

## Related pages

- [California](https://www.foundrole.com/locations/us/california?utm_source=ai_markdown) — 260759 jobs
- [Computer Hardware](https://www.foundrole.com/sectors/technology/computer-hardware?utm_source=ai_markdown) — 22574 jobs
- [Santa Clara, CA](https://www.foundrole.com/locations/us/california/santa-clara?utm_source=ai_markdown) — 6822 jobs

## Browse

- [Companies](https://www.foundrole.com/companies?utm_source=ai_markdown)
- [Jobs by country](https://www.foundrole.com/locations?utm_source=ai_markdown)
- [Jobs in the United States by state and city](https://www.foundrole.com/locations/us?utm_source=ai_markdown)
- [H1B sponsors by location](https://www.foundrole.com/h1b-sponsors?utm_source=ai_markdown)
- [H1B salaries](https://www.foundrole.com/h1b-salaries?utm_source=ai_markdown)
- [Sectors and industries](https://www.foundrole.com/sectors?utm_source=ai_markdown)
- [Jobs by career field](https://www.foundrole.com/careers?utm_source=ai_markdown)
- [Latest jobs](https://www.foundrole.com/jobs/latest?utm_source=ai_markdown)