Experimentation Tactics and Lessons

Career frameworks, A/B testing, onboarding tips, selling to engineers | Laura Schaffer (Amplitude)

Topic 2 of 3

Published Mar 9, 2023 · Clip 20:22–42:02 (21:39)

Laura recounts surprise experiments at Twilio, like adding signup questions that boosted conversion by 5% via 'good friction' addressing user psyche. She discusses iterative vs. redesign approaches, noting 80% failure rates and benefits of lower confidence intervals for faster testing. Emphasis on qualitative supplements and failing fast with mocks or painted doors to validate hypotheses efficiently.