
Model gateway, AI guard, and AIX foundations

Uber’s AI infra, from the inside
Topic 3 of 11
Published Oct 14, 2026 · Clip 19:06–29:31 (10:25)
Udai explains Uber's model- and harness-agnostic AI foundations. The model gateway, built in late 2023 on Michelangelo, exposes OpenAI- and Anthropic-compatible APIs for all vendors with AI guard middleware enforcing security/safety via fine-tuned models on every request/response, plus per-project spend tiers, attribution, and audit logging. AIX wraps all coding harnesses with managed personas, settings sync, and spend tracking. Udai also describes the cost-check plugin and the philosophy of spend tiers with minimal friction to maximize feature throughput.