
Overall Evaluation Criterion (OEC)

The ultimate guide to A/B testing | Ronny Kohavi (Airbnb, Microsoft, Amazon)
Topic 6 of 10
Published Jul 27, 2023 · Clip 26:38–36:36 (9:59)
Ronnie explains OEC as a constraint-optimized metric for long-term value, like revenue without harming UX (e.g., ad pixels budget at Bing). Examples include Airbnb's post-stay ratings prediction and Amazon email unsubscribes modeling spam costs, leading to features like campaign-specific opt-outs. Emphasizes lifetime value over short-term gains.