← BackReference (opens in a new tab)

More minutes, fewer returns

A hypothetical listening experiment produces conflicting signals. · PM Drills · 15 · 30 sec–2 min

More minutes, fewer returns · 30 sec–2 min

Situation

Spotify listening time rises 8%, but retention falls.

Imagine a test where minutes increase 8% and 30-day retention falls 4% relative. These are illustrative figures, not a report about Spotify.

Think before scrolling

What would you investigate before calling this successful?

Consider metric definitions, cohort maturity, audience mix, intentional listening, and uncertainty.

How a strong PM thinks

Interpret the outcomes together.

Verify exposure and tracking, compare equally mature cohorts, and inspect whether extra minutes are intentional or unattended autoplay. Segment relevant users and examine opt-outs, skips, and feedback.

A minutes increase may be valuable, but it cannot settle a conflicting retention result. Determine whether the change reflects better experiences for some people and worse control for others before choosing a rollout.

Takeaway

A proxy win does not override evidence of lost value.

Investigate the mechanism behind both movements and make the trade-off explicit.