Claim and evidence
Half a point is a fairly substantial difference on a 1–7 rating scale.NN/g test (4 iPhone apps, 70 participants) · nngroup.com · 2020-03-08
Secondary
A reputable third party analysed it (Lenny's Newsletter, First Round Review, Reforge, an Ahrefs study).
Success 91% vs 94%, not significant; perceived ease 4.92 vs 5.49.
Working · 2026-11 Expert usability research from 2020; four iOS apps only; complex enterprise tools may differ.
What the numbers show
No published number for this tactic has passed our word-for-word check yet, so there is no chart.
Why it works
NN/g's test found tutorials did not make people faster or more successful, and made tasks feel harder.
How to run it
- Test whether new users can finish key tasks without a tutorial
- Fix the UI where they fail
- Use contextual help for what is new
- Avoid feature promotion at first launch
Before / after
Generalised wireframe of the pattern, not a copy of any company's screen.
Ways to run it
Design options to test, not promised results.
- Option AFix the UI first
Test whether new users finish key tasks without help and redesign the screens where they fail.
- Option BContextual tips
Show a short hint at the moment a feature is first relevant instead of a deck at launch.
- Option CWhat's new only
Keep instructional screens for genuinely new or unusual features, not for standard patterns.
Timeline
- 12020 NN/g test (4 iPhone apps, 70 participants) — Group A read tutorials, group B skipped them.
- 22026-11 status checked: Working
Dated examples
- 2020
NN/g test (4 iPhone apps, 70 participants)
Group A read tutorials, group B skipped them.
Success 91% vs 94%, not significant; perceived ease 4.92 vs 5.49.
“Half a point is a fairly substantial difference on a 1–7 rating scale.”
✓ quote checked word-for-word on the pagenngroup.com · 2020-03-08
Does it still work?
Expert usability research from 2020; four iOS apps only; complex enterprise tools may differ.
Risks
- Study covered simple mobile apps; complex B2B tools may need training
Sources
- nngroup.com
“Our research shows that tutorials don’t make users faster or more successful at completing tasks”
✓ quote checked word-for-word on the page - nngroup.com
“Most mobile apps don’t need instructional onboarding.”
✓ quote checked word-for-word on the page
Change log
- 2026-11-20 — harvest v0.1 (activation)