Skip to content
A/BeeStart free

Hypothesis-driven testing

Test ideas, not just copy

A/Bee is split testing where the unit is a claim about why someone converts, not a pair of words. “B beat A” teaches you nothing you can use next month. “Longevity framing beats quality framing for this audience” does, and it is what gets filed.

What a hypothesis looks like

You describe the business once. The engine writes themes from conversion psychology and your context, and each theme spawns variations that argue it different ways.

Example · a store selling premium kitchen equipment

Theme 01 · Investment framing

Positioning the premium price as a long-term investment will reduce price sensitivity more than focusing on quality or features alone.

  • The last pan you'll ever need to buy.
  • Buy once. Cook forever.

Theme 02 · Frustration escape

Leading with the problems of cheap equipment will resonate more than leading with the benefits of premium equipment.

  • Done with pans that warp after six months.
  • No more hot spots. No more sticking.

Two different arguments for the same product, each written several ways. The test is not which sentence is better. It is which argument your audience responds to.

Separating the idea from the wording

One sentence per idea cannot tell you which of the two won. Several can.

  • The same idea, worded several ways. If it wins across phrasings, the argument is what resonated. If only one phrasing wins, that was a good sentence, not a finding.
  • Execution tracked on its own. Urgency, brevity, action verbs, personalization. These are followed separately from the hypothesis, so a strong style does not get credited to a weak idea.
  • A failed style does not sink a good idea. If a phrasing pattern loses, the engine checks whether it lost across several different hypotheses before holding it against any one of them.

A belief, and what moves it

Most tools hand you a pile of results. A/Bee keeps a list of things it believes about your audience, and every test moves one of them.

Untested
An idea worth trying, not yet put in front of anyone.
Promising
It won once. One win is a lead, not a conclusion.
Proven
A second win, or one large win on real volume. The biggest-looking result on thin data is usually the noisiest, and a lucky read should not become doctrine.
Disproven
Two decisive losses.
Exhausted
Three attempts with nothing to show.
Backfired
It won the headline metric and cost you signups. The sharpest lesson available, and never revisited.
  • A tie is a finding. Most tests produce no winner, and “no difference” is worth knowing. It is recorded against the idea rather than thrown away, so your traffic never buys the same answer twice.
  • Renaming an idea does not revive it. Beliefs are compared by meaning, not by label. “Low traffic solution” and “low traffic enabler” are one idea, and a retired one stays retired however it is worded next time.
  • A belief is re-proven in different words. The second win that makes an idea proven is written from scratch, not a rerun of the first. So what survives is the argument rather than the sentence, and a phrase that won once by luck does not get promoted to doctrine. It is a harder standard than most testing asks for, and it is the reason a belief here outlives the copy that carried it.
  • The evidence travels with it. Each outcome carries the numbers behind it, the control it was measured against, and how the call was made, so you can see why the engine believes what it believes.

Try it on your own site

Paste a URL and A/Bee hands back its first hypotheses for that page. Free, and no signup.

See what it would test