
Observations at Google: context engineering and oversight

Beyond Vibe Coding with Addy Osmani
Topic 4 of 11
Published Oct 29, 2025 · Clip 13:01–18:46 (5:45)
Addy shares what he observes at Google: traditional quality and due diligence practices remain, but prompt engineering and especially context engineering — optimizing the context window with project-specific files, examples, and details — have become central. He pushes his teams toward an 'AI-native engineer' mindset by asking whether handing a problem to AI first would speed them up. He and his leads are deliberately deepening expertise in evals, benchmarks, and RAG vs fine-tuning. He highlights maintaining human oversight as a big learning, citing external contributors submitting LLM-generated PRs (referencing Mitchell Hashimoto's frustration) and a study showing that increased code velocity makes human review the bottleneck.