Track 03 · 10 lessons
Data & Experimentation.
Interrogate the numbers before you make the call.
Completed: Metrics vs KPIs
Choose the few numbers that should change a decision.
Scroll lessonCompleted: North Star and Input Metrics
Use a shared measure without allowing it to flatten the product's value.
Scroll lessonCompleted: Funnels
Locate conversion loss without assuming the largest drop is the best opportunity.
Scroll lessonCompleted: Activation
Find evidence that the user has experienced the product's value.
Scroll lessonCompleted: Retention and Cohorts
Compare like with like to understand who keeps receiving value.
Scroll lessonCompleted: Instrumentation
Make sure the event means what the decision assumes it means.
Scroll lessonCompleted: Segmentation
Check whether a changing mix is telling a false story.
Scroll lessonCompleted: A/B Testing
Use controlled comparisons while respecting uncertainty and interference.
Scroll lessonCompleted: Data Traps
Challenge a plausible conclusion without getting stuck forever.
Scroll lessonCompleted: From Data to Recommendation
Move from an observation to a bounded product decision.
Scroll lesson