
The Era of Evals

Why experts writing AI evals is creating the fastest-growing companies in history | Brendan Foody
Topic 1 of 8
Published Sep 18, 2025 · Clip 5:42–9:28 (3:46)
Brendan explains evals as essential for measuring model success, comparing them to product requirement documents that guide researchers in experiments and reinforcement learning. He discusses how evals enable hill-climbing improvements, citing rapid saturation in benchmarks like Olympiad math and SWE-bench. The conversation emphasizes evals as barriers to automating workflows and advice for enterprises to build tests measuring AI's impact on their value chains.