
Surprising A/B Test Examples

The ultimate guide to A/B testing | Ronny Kohavi (Airbnb, Microsoft, Amazon)
Topic 2 of 10
Published Jul 27, 2023 · Clip 4:30–10:54 (6:24)
Ronnie shares surprising A/B test results, including a Bing ad title swap boosting revenue by 12% and the new tab opening for search results improving engagement. He discusses the trivial implementation leading to massive impact, follow-on experiments, and how these humble predictions about outcomes.