Whenever the A/B test rule completes, the winning content is determined by the Acoustic Personalization. You can also set the best winning content manually and create a rule for personalization.
View the performance of the A/B test
You can select the zone for which you want to view the rules. On Zone details page, Click Published rules. Click Actions > View details.
The A/B test details are displayed in the A/B test configuration pane.
To see the details of the A/B test progress, click Performance.
Determine the winning variant
When the A/B test end date is reached then the test is completed. In the A/B test configuration pane, the status of the A/B test is Active - Completed. If the statistical significance is reached, then the system automatically sets the winning variant and it is displayed in the Winning variant field.
Create a rule with winning content
You can view that the statistical significance is reached for this A/B test. The winning content is selected by default. Click Use winning content. On the confirmation box, click Yes.
You can do any one of the following actions:
- Click Save to save the rule.
- You can use Save and publish to publish the rule. Rule is successfully created and published.
Create a rule with new variant
The statistical significance must be reached for the A/B test and the winning content must be determined for the completed test. You can override the winning content by selecting new content. On the Performance pop-up, select the new variant and click Use selected content. On the confirmation box, click Yes. In the Rule details screen, either click Save or Save and publish. Rule is successfully created and a string _Winner is appended to the rule name.
Create a rule when statistical significance is not reached
Click Published rules.Use View details to view your A/B test for which end date is over, but statistical significance is not reached. The status of your A/B test rule is Paused - Inconclusive.
In the A/B test configuration pane, click Performance to set your own winning variant manually. Performance window opens. Select the content variant and then click Use selected content. Click Yes. Your will see a message: "Creating a rule with incomplete test may lead to inaccurate results". You can use Save and publish to publish the rule. Rule is successfully created in Active - In progress state.