Note: The job is a remote job and is open to candidates in USA. Luma is dedicated to building multimodal AI to enhance human capabilities, relying on a robust GPU infrastructure. They are seeking a Senior Site Reliability Engineer to architect, maintain, and scale their infrastructure across on-prem and multi-vendor clouds, ensuring high availability and performance for their AI systems.

Responsibilities

• Architect for Reliability & Scale: Participate in critical re-architecture sessions to redesign our systems for higher efficiency and scale. You won't just maintain existing clusters; you will help define how our next-generation infrastructure operates
• Own Multi-Cloud GPU Clusters: Take end-to-end ownership of our production clusters for training and inference across AWS and OCI, ensuring high availability and peak performance
• Drive Security & Compliance: Assist in achieving and maintaining security certifications (SOC 2 Type 1 & 2, ISO standards) by implementing robust infrastructure security practices in a fast-moving AI startup environment
• Deep Linux Performance Tuning: Use your mastery of Linux systems to troubleshoot and optimize performance at the OS and kernel level
• Build Robust Automation: Write high-quality tools and automation in Python, Go, or Bash to manage, monitor, and heal our infrastructure without relying on heavy operational toil
• Debug Complex Hardware/Software Failures: Serve as the final escalation point for the most challenging GPU, networking (InfiniBand/RDMA), and system-level issues, often collaborating directly with hardware vendors like NVIDIA

Skills

• 5+ years of experience as an SRE, production engineer, or infrastructure engineer in a fast-paced, large-scale environment
• Deep Linux Mastery: You possess deep, hands-on expertise in Linux, containerized systems, and debugging low-level system performance
• Expert in Technologies: You have working experience with Terraform, Airflow, and Ray
• Cloud Infrastructure Expert: You have strong experience with providers like AWS or OCI
• Tenacious Troubleshooter: You thrive on solving complex, low-level problems where hardware and software intersect
• Startup DNA: You are energetic and thrive in a less structured, fast-paced environment
• Security-Minded: You possess a working knowledge of security best practices and familiarity with compliance frameworks, such as SOC 2 and ISO
• Expert in High-Performance Networking: You have practical experience with InfiniBand, RDMA, or RoCE and understand how to optimize throughput for massive distributed training jobs
• Deep expertise with GPU tooling for NVIDIA and AMD GPUs like DCGM or ROCm
• Experience managing large-scale GPU clusters for AI/ML workloads (training or inference)
• Familiarity with job management systems based on Kubernetes or orchestration frameworks like Ray
• Deep expertise in Data Pipeline and Infrastructure

Company Overview

Company H1B Sponsorship