Working · 2026-11PrimaryAcquisitionMarketplaces

App Store product page A/B tests

Test up to three alternate icons, screenshots or app previews against the default page on the App Store.

Also called: App Store product page A/B tests

Claim and evidence

The claimThe new icon with the smiling witch smashed the previous two, with a 9.1% conversion lift.

MyTona (Seekers Notes) · gameanalytics.com · 2017-09-11

What the numbers show

9.1%

conversion lift for the smiling-witch icon in MyTona's icon tests (vendor-reported, third-party testing)

gameanalytics.com

Why it works

Diagram, not data
Pick one asset tovaryUp to threetreatmentsDefault product pageApply the winner
Pick one asset to varyUp to threetreatmentsDefault productpageApply the winner

Treatments are shown to randomly selected visitors so you can see which assets convert best.

How to run it

  1. Pick one asset to vary
  2. Create up to three treatments
  3. Run the test
  4. Apply the winner

Before / after

Before
Product
Get
Default icon and screenshots
After
Product
Treatment
Get
Treatment with a new icon for some visitors

Generalised wireframe of the pattern, not a copy of any company's screen.

Ways to run it

Design options to test, not promised results.

  1. Option AIcon series

    Test icon concepts one after another and keep the winner as the new baseline, as MyTona did.

  2. Option BScreenshot story

    Hold the icon fixed and test which screenshot order explains the app best.

  3. Option CApp preview video

    Test a page with an app preview against one with screenshots only.

Dated examples

  1. —

    MyTona (Seekers Notes)

    Ran a series of store icon A/B tests comparing a man in a hat, a pumpkin head and a smiling witch (third-party store testing, before Apple's native tool).

    The smiling-witch icon beat both earlier icons with a 9.1% conversion lift (vendor-reported).

    “The new icon with the smiling witch smashed the previous two, with a 9.1% conversion lift.”
    ✓ quote checked word-for-word on the page

    gameanalytics.com · 2017-09-11

Does it still work?

Workingas of 2026-11

Apple documentation, copyright 2026 source

Risks

  • Needs enough traffic
  • Page does not say organic-only

Sources

  1. developer.apple.com · Apple Developer · undated
    “A test can include up to three treatments with alternate app icons, screenshots, and app previews.”
    ✓ quote checked word-for-word on the page
  2. developer.apple.com · App Store Connect Analytics Help · undated
    “Conversion lift: Understand the estimated relative improvement of each treatment compared to your baseline, helping you quantify the impact of specific creative changes.”
    ✓ quote checked word-for-word on the page

Change log

  • 2026-11-20 — merged: pass2-enrich.jsonl:18 (apple-product-page-optimization-tests); acq-search.jsonl:45 (apple-product-page-optimization-tests)
  • 2026-11-20 — harvest v0.1 (pass2-enrich, acq-search)