Reading the Report

Open Alpha Insights → A/B Test → Report (also under Website Traffic as A/B Tests). The A/B Test list shows the same warehouse metrics for all time. The report is date-filtered (default last 30 days) and includes charts plus a full variant table.

You can filter the report to one or more A/B tests from the filters modal (Pro for custom filter sets, same as other reports).

Headline metrics

Metric What it measures
Exposures Assigned visitors who saw a variant. This is the conversion-rate denominator.
Conversions Exposed visitors who completed the A/B test’s primary goal. For Purchases, purchase value, and average order value, that is an attributed purchase.
Conversion rate On the date-filtered report this is conversions ÷ exposures (purchase rate for purchase-based goals). On the list, Target conversion can switch the rate to add-to-cart rate, checkout rate, revenue per visitor, revenue per exposure, or AOV.
Lift vs control How far a treatment sits above or below that test’s own control on the selected rate. Control is not given a lift.
Add to carts / initiate checkouts / purchases Funnel counts from the same exposed sessions. Rates are also available as % of exposures.
Sessions / duration Analytics sessions joined to exposed assignments.

Pro-only columns and goals

Free lists and reports stay on Purchases. Revenue, revenue per exposure, AOV, profit, significance, and the value goals require Pro.

Charts

How to read a result

  1. Confirm both arms have meaningful exposures. Very small samples swing wildly.
  2. Match the metric to the hypothesis: purchase rate for conversion tests, revenue per exposure or AOV (Pro) when the change is about value rather than volume.
  3. Use the funnel (add to cart → initiate checkout → purchase) to see where a treatment helps or hurts.
  4. In Pro, wait for significance before you ship a small lift. A “leading” badge on the list is only the current highest rate for the selected target conversion, not a statistical call.
  5. If the list and report disagree, check the report date range. The list is all-time.

Metric names in Report Builder

A/B test fields are labelled with an Experiment - prefix in pickers so they stay distinct from website traffic and orders. You can add them to custom reports the same way as other warehouse entities.

Related