A/B Testing ships in Alpha Insights Free with a focused workflow. Pro unlocks more arms, tighter targeting, PHP, and statistical / commercial metrics on the report.
| Capability | Free | Pro |
|---|---|---|
| Running tests at once | 1 | Multiple (a visitor is still only in one running test at a time) |
| Variants | Control + one treatment | A/B/n with per-arm weights |
| Traffic in test | 100% of eligible visitors | Holdout % (withhold some eligible visitors) |
| Snippets | CSS and JavaScript | CSS, JavaScript, and PHP |
| Page targeting | Path equals, path contains, cart, checkout, product | Plus path starts with, shop, post type, URL regex |
| Audience | All eligible page traffic minus analytics-excluded roles | Traffic source, device, logged in, new vs returning |
| Primary goal | Purchases | Purchases, purchase value, revenue per exposure, average order value, add to cart, page view, or custom event |
| Schedule | Manual start / pause / complete | Optional start and end datetimes |
| Report | Exposures, conversions, rates, lift, funnel | Plus revenue, revenue per exposure, AOV, profit, and significance vs that test’s control. Purchase value, revenue per exposure, and AOV goals score lift from those commercial metrics. |
| Report filters | Default date range | Custom filters, including one or more A/B tests |