
Long-Term Experimentation and Metrics

Breaking the rules of growth: Why Shopify bans KPIs, optimizes for churn, and prioritizes intuition
Topic 2 of 6
Published Nov 7, 2024 · Clip 11:11–24:46 (13:35)
Archie describes Shopify's long-term experimentation approach, holding out cohorts for years to measure true GMV impact beyond short-term lifts. Core product teams avoid KPIs, focusing on 100-year vision, while growth uses leading indicators but revisits experiments at 3, 6, 9, and 12 months. Many short-term wins fade, often pulling forward activity without sustained value, but some reveal high-value merchant pockets via reduced monetary friction.