How Researchers Peer Inside Models

A mind-expanding conversation on how models actually work | Emmanuel Ameisen (Anthropic)

Topic 5 of 18

Published Oct 18, 2026 · Clip 18:33–23:02 (4:30)

Emmanuel explains the concrete method: intermediate results are lists of numbers; researchers pass massive amounts of text through models, record activations, and look for patterns (like neuroscience brain scans linking stimuli to brain regions). Once decoded, they run experiments and even edit activations to see causal effects. He reflects that the job is sci-fi-like and closer to biology than software engineering because there's no comprehensible source code — you run experiments on the system like a biologist studying a hungry mouse.