Context window and long codebases

Building Windsurf with Varun Mohan

Topic 7 of 16

Published May 7, 2025 · Clip 23:57–27:03 (3:06)

The host raises the criticism that tools degrade as codebases grow. Varun agrees it's a hard problem: models lack infinite context, larger context costs more time and money, and developers hate waiting for imperfect answers. He describes approximations like checkpointing long conversations and improving retrieval confidence, arguing the solution will be a combination of better checkpointing, context use, faster LLMs, and deeper codebase understanding—no silver bullet.