Senior Site Reliability Engineer (SRE) - AI Inftastructure Job at Confidential, San Francisco, CA

  • Confidential
  • San Francisco, CA

Job Description

Join a stealth-mode startup building out their AI and cloud platform, powered by thousands of H100s, H200s, and B200s, ready for experimentation, full-scale model training, or inference. As a Platform Engineer/Senior Site Reliability Engineer, you’ll own the reliability, performance, and automation of this GPU-powered infrastructure, ensuring seamless orchestration across environments managed by Slurm, Kubernetes, or direct SSH access. As well as supporting their extremely exciting new products coming to the market! 

This is a rare opportunity to work at the intersection of AI infrastructure and AI, shaping the operational backbone of one of the largest GPU clusters in private deployment.

If you want to build and operate infrastructure for frontier AI workloads, automate systems at petascale, and be part of a founding engineering team, this is the place to do it. Get in touch and apply today! 

Responsibilities:

  • Design, deploy, and maintain large-scale GPU clusters (H100/H200/B200) for training and inference workloads.
  • Build automation pipelines for provisioning, scaling, and monitoring compute resources across Slurm and Kubernetes environments.
  • Develop observability, alerting, and auto-healing systems for high-availability GPU workloads.
  • Collaborate with ML, networking, and platform teams to optimise resource scheduling, GPU utilisation, and data flow.
  • Implement infrastructure-as-code, CI/CD pipelines, and reliability standards across thousands of nodes.
  • Diagnose performance bottlenecks and drive continuous improvements in reliability, latency, and throughput.

Skills / Must Have:

  • 7+ years of experience in SRE, DevOps, or Infrastructure Engineering roles supporting large-scale compute environments.
  • Strong hands-on experience with Kubernetes and Slurm for cluster orchestration and workload management.
  • Deep knowledge of Linux systems, networking, and GPU infrastructure (NVIDIA H100/H200/B200 preferred).
  • Proficiency in Python, Go, or Bash for automation, tooling, and performance tuning.
  • Experience with observability stacks (Prometheus, Grafana, Loki) and incident response frameworks.
  • Familiarity with high-performance computing (HPC) or AI/ML training infrastructure at scale.
  • Background in reliability engineering, distributed systems, or hardware acceleration environments is a strong plus.

Salary & Benefits:

  • $300,000 gross per year 
  • Equity

Job Tags

Permanent employment

Similar Jobs

PLS Staffing Solutions

Documentation Control Specialist - R Job at PLS Staffing Solutions

Currently seeking a Document Control Specialist (1st Shift) for our Amesbury, MA location. Onsite Monday - Friday 8 AM EST - 5 PM EST Salary Range: $60,000 - $75,000 The selected individual will be responsible for but not limited to the following obligations: Manages controlled...

AMAROK

Treasury and Financial Reporting Analyst Job at AMAROK

 ...purpose in our career opportunities. Job Summary We're looking for a highly motivated and detail-oriented Treasury and Financial Reporting Analyst to join our team! In this crucial role, you'll manage both treasury operations and financial reporting activities. You'll... 

JAM Enterprises LLC

Construction Entry Level Job at JAM Enterprises LLC

 ...CONSTRUCTION APPRENTICE ENTRY LEVEL $25.00 hour to start ~ No experience needed ~ Performance based pay increases ~ Four-day work weeks ~ Free parking ~401K ~ Medical benefits A local, family-owned, construction services company that truly cares about... 

FiOptix

Field Labor Inspector/Quality Control Job at FiOptix

 ...successfully, an individual must be able to perform each essential duty mentioned satisfactorily. The requirements listed below are representative of the knowledge, skills, and/or ability required.Education: High school diploma, general education degree (G.E.D.), or... 

Ambition 24Hours Inc

Travel Respiratory Therapist (RRT) Job at Ambition 24Hours Inc

 ...Travel Respiratory Therapist (RRT) - Travel Contract Travel Contract | Lubbock, TX 79401 | Nights Shift TRAVEL POSITION - OPEN TO ALL LOCATIONS Job Title Travel Respiratory Therapist (RRT) Employment Travel Contract...