Experimentation at Etsy

Inside Etsy’s product, growth, and marketplace evolution | Tim Holley (VP of Product)

Topic 7 of 13

Published Sep 3, 2023 · Clip 35:00–38:01 (3:01)

Most changes run A/B tests, but Etsy expands to cohorts for retention and pre-post for untestable areas like sales honoring. 80% experiments fail, focusing on learning and minimizing waste. A/B roots from engineering culture, but new methods validate net-new features without causal certainty.