Note: The job is a remote job and is open to candidates in USA. Indeed is the world’s number 1 job site, and they are seeking a Senior Software Engineer to join their AI Gateway & Guardrails team. The role focuses on developing platform services that connect AI-powered products to language models while ensuring compliance and quality standards for production AI deployment.

Responsibilities

• Design, implement, and maintain platform services that provide secure, scalable, and reliable access to LLM and SLM providers across multiple cloud environments
• Contribute to multi-provider access, failover, and rate-limiting capabilities across cloud platforms (Azure, AWS, and GCP)
• Drive improvements to the AI Guardrails Platform, such as content moderation and Personally Identifiable Information (PII) redaction
• Facilitate technical discussions and contribute architectural decisions at the service and system level
• Identify and implement reliability improvements through SLOs, observability tooling, alerting, and runbook development
• Collaborate with engineers, product managers, and governance partners across teams to deliver compliant, production-ready AI systems
• Share knowledge and provide technical guidance with teammates

Skills

• Requires a Bachelor's degree in Computer Science, Mathematics, Computer Engineering, or Electrical Engineering, and a minimum of 5 years of related experience; or a Master's degree with a minimum of 3 years of experience; or a PhD without experience
• Experience building or operating large-scale distributed systems, ideally within platform or infrastructure environments
• Proficiency with cloud infrastructure across major providers (AWS, GCP, or Azure), including deployment, monitoring, and operations
• Experience with or interest in AI/ML systems, including LLM-based services, prompt engineering, or AI safety approaches
• Familiarity with reliability engineering practices such as SLOs, error budgets, observability tools, and on-call readiness
• Solid grounding in data structures, algorithms, and core computer science principles, with a track record of solving complex technical problems
• Demonstrated ownership, accountability, and a proactive mindset, paired with curiosity and a drive to continuously learn

Benefits

• Quarterly bonuses
• Restricted Stock Units (RSUs)
• Paid Time Off policy
• Many region-specific benefits
• Reasonable accommodations to qualified individuals with disabilities in the employment application process

Company Overview

Company H1B Sponsorship