
Latency, Revenue, and Monolith-to-Microservices

What is a Principal Engineer at Amazon? With Steve Huynh
Topic 4 of 11
Published Jul 9, 2025 · Clip 16:40–26:36 (9:55)
Steve explains Amazon found a clear correlation (arguably causation) between page latency and gross revenue, driving a big focus on latency. He advocates starting from first principles—'why can't we be at 1 millisecond?'—and explains that the conceptually fastest design is a monolith, which is how Amazon started with big Sun boxes and a C++ web server. They cover hitting the 4GB 32-bit binary wall in the early 2000s, the pivot to service-oriented architectures, and how microservices trade latency for maintainability. Steve also describes work at Prime Video on reducing personalization under high load and agrees startups should start with a monolith until roughly 50 developers break it.