Metrics vs KPIs
Choose the few numbers that should change a decision. · Data & Experimentation · Lesson 31 · 3 min
Metrics vs KPIs · 3 min
Situation
The dashboard grows; clarity does not.
A team reviews visits, sessions, clicks, exports, invitations, signups, revenue, and support tickets every Monday. Nobody knows which movement should change the week's work.
A metric is a measurement. A key performance indicator is a metric selected to track an important objective. Calling every number a KPI removes the distinction.
Mental model
Connect the measure to the outcome.
Start with the decision and desired result. If the goal is successful team adoption, qualified teams returning to complete useful work may matter more than raw invitation clicks.
Define numerator, denominator, time window, eligible population, and owner. “Engagement improved” is not a reproducible measurement until those choices are explicit.
Example
Leading and lagging measures work together.
Paid renewal is a lagging indicator: it tells you an outcome after time has passed. Repeated use of a valuable workflow may be a leading indicator if evidence suggests it predicts renewal.
A leading measure is a hypothesis about future value, not a guarantee. Verify the relationship and reconsider it when the product or customer mix changes.
Failure case
An easy number replaces the goal.
A team increases notification volume and sees more app opens. If users mute notifications or leave, opens have become a misleading proxy.
Keep guardrails such as opt-outs, complaints, and retention alongside the targeted measure. A number is useful only in relation to the outcome it is meant to represent.
PM question
What action follows a change?
For each proposed KPI, write what an increase, decrease, or stable result would prompt you to investigate. If no plausible result would change a decision, it may belong in diagnostic reporting rather than the core review.
Do not discard supporting metrics. Use them to explain changes in the few outcomes that matter.
Remember this
A KPI earns its place through a decision.
Measure broadly enough to diagnose, but focus attention on a small set of defined outcomes and useful leading signals. More charts do not automatically create more understanding.