Claim and evidence
Account for effects that fade (novelty) or grow (primacy) over time before treating early lifts as permanent.
No dated example yet. Treat this tactic as a hypothesis.
Primary
The company or founder describes the tactic and its result themselves: own blog, talk, filing.
Working · 2026-11 Described in a 2021 Microsoft paper; practical guidance such as two-week minimums comes from practitioner blogs, not fetched.
What the numbers show
No published number for this tactic has passed our word-for-word check yet, so there is no chart.
Why it works
Users react to something new, then settle, or learn a change and use it more later. Reading a test too early captures the temporary effect.
How to run it
- Plot the treatment effect by day
- Compare new versus returning users
- Extend the test if the effect is still moving
- Confirm winners with a holdout
- Prefer long-term estimators for big UI changes
Ways to run it
Design options to test, not promised results.
- Option ANew versus returning users
Compare the effect for first-time users with returning ones; novelty shows up mostly in the returning group.
- Option BLonger run for big UI changes
Run large interface changes longer than usual so learning and fading effects play out.
- Option CPost-launch holdout
Keep a small group on the old version after launch to check whether the lift persists.
Timeline
- 12021 first documented: Sadeghi et al., Microsoft researchers, arXiv
- 22026-11 status checked: Working
Dated examples
No dated example yet. Treat this tactic as a hypothesis.
Does it still work?
Described in a 2021 Microsoft paper; practical guidance such as two-week minimums comes from practitioner blogs, not fetched. source
Risks
- Hard to tell a novelty effect from noise in short tests
- No universal duration rule
Sources
- arxiv.org
“Novelty describes the desire to use new technology that tends to diminish over time.”
✓ quote checked word-for-word on the page - arxiv.org
“Primacy describes the growing engagement with technology as a result of adoption of the innovation.”
✓ quote checked word-for-word on the page
Change log
- 2026-11-20 — harvest v0.1 (ops-ai)