You can monitor the effectiveness of your A/B test by using the performance details for your A/B test rule.
You can track the progress of your A/B test, by capturing and reporting the display count and the click rate that are received on each variant for that zone.
View the performance details for my A/B test
Ensure that you are on the zone details page.
- Click Published rules.
- Click action menu of the A/B test rule then click View details.
- In the A/B test configuration pane, click Performance details.
Performance details for A/B test
- A/B test status:
- Complete: When the A/B test duration is over and statistical significance is reached, then the winning content would be calculated and selected by default.
- In progress: When the A/B test is in progress and statistical significance is not yet reached, then the test continues to run. You can manually stop the test if required.
- Paused - Inconclusive: A/B test rule is active and the end date is passed today's date but the statistical significance is not reached yet.
- Stopped: A/B test rule is stopped.
- Primary metric: Primary metric of the A/B test such as click rate.
- Statistical significance: Percentage of statistical significance reached for the A/B test.
- Winning content: Winning content is calculated when the A/B test rule is completed and the statistical significance is met.
- Click rate by variants : This chart provides data about the click rate for each variant across a time period.
Metric |
Definition |
Calculation |
Display count |
Total number of times the variant is displayed on a zone. |
Number of times the variant was shown in a zone in total. For example, if variant is displayed five times on a zone, the total would come as 5. |
Click rate (%) |
Percentage of total clicks on the variant out of the total number variants shown on a zone. |
Calculation: Click rate = (Number of times variant is clicked / Number of times variant is shown) x 100 |
Table 1. Metrics by variants |
Export the A/B test performance details
You can export and save the performance details of your A/B test as a PDF file.
If you want to save the performance of your A/B test offline on your computer for future reference, use the Export to PDF feature available on the Performance details page. Perform the following steps.
Note The Export to PDF option is only available for A/B tests with the following status:
- Active - In Progress
- Active - Stopped
- From the Zones, open the zone details page.
- Click Published rules.
- Click action menu of the A/B test rule then click View details.
- In the A/B test configuration pane, click Performance details.
- The page displays Performance details for the A/B test, such as:
- A/B test status
- Primary metric
- Statistical significance
- Winning content
- Click rate by variants chart
- To export the performance details information, click Export to PDF.
A PDF file named performance-details.pdf is downloaded to your computer. The PDF file contains all the information displayed on the Performance details page, including the click rate by variants chart.