Adversarial Robustness and Measurement

Why securing AI is harder than anyone expected and the coming security crisis | Sander Schulhoff

Topic 9 of 14

Published Dec 21, 2025 · Clip 23:56–25:35 (1:39)

The host notes ServiceNow's failed guardrail. Sander defines adversarial robustness as a system's defense against attacks, applicable to models or full systems. ASR (Attack Success Rate) measures it: low ASR means high robustness, e.g., 1% ASR if 1/100 attacks succeed.