While a test is running, targeted URLs miss full-page cache so WordPress can assign a variant and print its CSS, JS, or PHP on the first HTML response. Other URLs stay cached. Pause or complete the test to restore cache on those URLs.
This is different from cache-safe analytics. Analytics is designed not to bust HTML cache. A/B tests must vary HTML, so only the URLs you target are excluded, and only while the test runs.
Alpha Insights registers exclusions for common stacks:
wpd_ai_experiment_bypass_cache action fires so other cache layers can opt in.If you use Cloudflare, another CDN, or a host-level cache that ignores those hooks, add the same URL patterns as cache bypass rules for the duration of the test. Otherwise visitors may all see a cached control (or a cached treatment) and your results will be wrong.
/pricing, a landing page, cart, checkout) over “entire site”.