
Writing About a Fast-Moving Field

AI Engineering with Chip Huyen
Topic 3 of 14
Published Feb 5, 2025 · Clip 6:35–11:33 (4:59)
Chip explains how she wrote a book in a fast-moving field: she focuses on fundamentals that have existed for a long time (language modeling since Shannon in the 1950s, retrieval, vector search) and makes bets on which capabilities will persist. She gives examples such as prompt tips becoming less relevant as models get more robust, and context length becoming a question of context efficiency. She also reflects on multimodality, which people said she was too early on in 2023 but which is now ubiquitous.