Claim and evidence
we established one foundational rule: protect the channel.Duolingo · lennysnewsletter.com · 2023-02-28
Primary
The company or founder describes the tactic and its result themselves: own blog, talk, filing.
Rule stated by former CPO.
Working · 2026-11 Airship's 2025-data benchmark shows median iOS direct open rate down 13.71% and Android volume down 15%, consistent with fatigue.
What the numbers show
No published number for this tactic has passed our word-for-word check yet, so there is no chart.
Why it works
Every extra push raises the chance a user opts out, and opt-out is permanent loss of a free channel. Treating channel health as a constraint stops short-term lifts from burning long-term reach.
How to run it
- Set a rule: tests can change timing and copy, not volume
- Require a high bar before adding a new notification
- Track opt-out rate alongside the lift
- Retire winners that damage opt-outs
Ways to run it
Design options to test, not promised results.
- Option ATiming and copy only
Tests may change when and what you send, never how much, as in Duolingo's rule.
- Option BHigh bar for new notifications
Require a strong case before any new notification type is added.
- Option COpt-out guardrail
Report the opt-out rate next to the lift for every notification test.
- Option DRetire spammy winners
Switch off notifications that win tests but feel too spammy, as Duolingo has done.
Timeline
- 12023 Duolingo — Team could tune push timing and copy but not send more.
- 22024 Duolingo — Engineering VP says some notifications that won tests were killed as too spammy.
- 32026 Airship benchmark — Vendor survey cites over-frequency as top opt-out reason.
- 42026-11 status checked: Working
Dated examples
- 2026
Airship benchmark
Vendor survey cites over-frequency as top opt-out reason.
“the top reason users opt out is because messages get sent “too frequently.””
✓ quote checked word-for-word on the pageairship.com · undated
- 2024
Duolingo
Engineering VP says some notifications that won tests were killed as too spammy.
“We've killed some notifications that were huge wins”
✓ quote checked word-for-word on the pagelennysnewsletter.com · 2024-04-02
- 2023
Duolingo
Team could tune push timing and copy but not send more.
Rule stated by former CPO.
“we established one foundational rule: protect the channel.”
✓ quote checked word-for-word on the pagelennysnewsletter.com · 2023-02-28
Does it still work?
Airship's 2025-data benchmark shows median iOS direct open rate down 13.71% and Android volume down 15%, consistent with fatigue. source
Risks
- Hard to see opt-out cost in a single test window
Sources
- lennysnewsletter.com
“we established one foundational rule: protect the channel.”
✓ quote checked word-for-word on the page - lennysnewsletter.com
“We've killed some notifications that were huge wins”
✓ quote checked word-for-word on the page - airship.com
“the top reason users opt out is because messages get sent “too frequently.””
✓ quote checked word-for-word on the page
Change log
- 2026-11-20 — harvest v0.1 (retention)