Track 03 · 10 lessons
Data & Experimentation.
Interrogate the numbers before you make the call.
Metrics vs KPIs
Choose the few numbers that should change a decision.
Scroll lessonNorth Star and Input Metrics
Use a shared measure without allowing it to flatten the product's value.
Scroll lessonFunnels
Locate conversion loss without assuming the largest drop is the best opportunity.
Scroll lessonActivation
Find evidence that the user has experienced the product's value.
Scroll lessonRetention and Cohorts
Compare like with like to understand who keeps receiving value.
Scroll lessonInstrumentation
Make sure the event means what the decision assumes it means.
Scroll lessonSegmentation
Check whether a changing mix is telling a false story.
Scroll lessonA/B Testing
Use controlled comparisons while respecting uncertainty and interference.
Scroll lessonData Traps
Challenge a plausible conclusion without getting stuck forever.
Scroll lessonFrom Data to Recommendation
Move from an observation to a bounded product decision.
Scroll lesson