Working · 2024-04PrimaryRetentionProduct

League-based leaderboards

Group users into small weekly leagues and rank them by activity so effort is compared with peers.

Also called: weekly leagues

Claim and evidence

The claimThe leaderboards feature had a huge and almost immediate impact on our metrics.

Duolingo · lennysnewsletter.com · 2023-02-28

What the numbers show

1%

D1 retention lift in the leaderboard experiment (Duolingo, company-reported)

lennysnewsletter.com
2%

D7 retention lift in the same experiment

lennysnewsletter.com
3%

D14 retention lift in the same experiment

lennysnewsletter.com

Why it works

Diagram, not data
Join a small weeklyleagueRank by weeklyactivityPromote or demoteat week endFresh start nextweek
Join a smallweekly leagueRank byweeklyactivityPromote ordemote atweek endFresh startnext week

Relative standing adds a competitive reason to be active beyond the personal goal, and weekly resets give repeated fresh chances. Duolingo copied the pattern from a game rather than inventing it.

How to run it

  1. Bucket users into small cohorts by level
  2. Rank by an activity score weekly
  3. Promote and demote at week end
  4. Measure retention and time spent against a holdout

Before / after

Before
Your weekly goal
Keep going
Activity measured only against a personal goal
After
This week's league
Top places move up
You
Another learner
Third learner
League resets at the end of the week
Earn more points
A small league ranked by this week's activity

Generalised wireframe of the pattern, not a copy of any company's screen.

Ways to run it

Design options to test, not promised results.

  1. Option ALevelled cohorts

    Group users of similar level so the ranking feels winnable.

  2. Option BPromotion and demotion

    Move top users up and bottom users down each week, as Duolingo's leagues do.

  3. Option CHoldout measurement

    Keep a group without leagues to measure retention and time spent against.

Timeline

  1. 12023 first documented: Jorge Mazal in Lenny's Newsletter
  2. 22023 Duolingo — Added league leaderboards adapted from a mobile game.
  3. 32024 Duolingo — Engineering VP gives experiment deltas for the leaderboard.
  4. 42024-04 status checked: Working

Dated examples

  1. 2024

    Duolingo

    Engineering VP gives experiment deltas for the leaderboard.

    D1 +1%, D7 +2%, D14 +3% retention; time spent about +17%.

    “D1 retention went up 1%, D7 retention went up 2%, and D14 retention went up 3%.”
    ✓ quote checked word-for-word on the page

    lennysnewsletter.com · 2024-04-02

  2. 2023

    Duolingo

    Added league leaderboards adapted from a mobile game.

    Former CPO reports an almost immediate effect on metrics.

    “The leaderboards feature had a huge and almost immediate impact on our metrics.”
    ✓ quote checked word-for-word on the page

    lennysnewsletter.com · 2023-02-28

Does it still work?

Workingas of 2024-04

Still referenced by Duolingo leaders in 2024; effect depends on a large active user base. source

Risks

  • Needs enough active users to fill leagues
  • Competitive pressure can alienate casual users

Sources

  1. lennysnewsletter.com · Lenny's Newsletter · Jorge Mazal · 2023-02-28
    “The leaderboards feature had a huge and almost immediate impact on our metrics.”
    ✓ quote checked word-for-word on the page
  2. lennysnewsletter.com · Lenny's Newsletter · Sean Colombo · 2024-04-02
    “D1 retention went up 1%, D7 retention went up 2%, and D14 retention went up 3%.”
    ✓ quote checked word-for-word on the page

Change log

  • 2026-11-20 — harvest v0.1 (retention)