A/B Testing consists in comparing several versions of an image, a text, or a button label, to check which one is the most efficient. These variations are presented in linear or random ways to the users of your chatbot.

A real-time statistical analysis makes it possible to consult how effective may be various versions, according to the rate of click on actions (buttons). In other words, you can check which version triggers the most clicks, subscriptions, purchases, etc. 

The results of the analysis therefore can help determine the best strategy to be adopted. And from then on, you can adapt and improve your strategy to get even more optimal user engagement!


In this example, the analysis points out the following information: 

• The menu has been displayed 10 times in your chatbot
• The buttons have been clicked 7 times in 70% of cases
• The "Blue" button was clicked in 20% of cases
• The "Red" button was clicked in 50% of the cases

This analysis underlines that the "Choice 2" button obtained a much better performance than the first button. "Choice 2" deserves to be put forward. Another option would be to replace the title of the first button with something more appealing.

The following elements are generally used in A/B Testing: texts, images, and especially button labels, as well as quick replies. These are all elements which can be cleverly used to measure an action rate.

However, the BOTNATION A/B Testing goes much further, by allowing to test a greater number of combination! To obtain this optimal tool, it is necessary to couple A/B Testing statistics with rotations. 

Rotations allow to alternately add several elements of the same type (text, image, video, etc.). BOTNATION will choose one of the elements to send to the user of your chatbot, according to the type of rotation (linear or random).

Here’s an example of linear rotation statistics on two versions of a menu. This example underlines the following information:

• BOTNATION will display 1 of 2 times linearly each version of this menu
• The first version generates 60% of actions (clicks) on the buttons
• The second version generates 77% of actions (clicks) on the buttons
• The wording of the first button of the second version also generates 55% of actions

We can therefore conclude from this analysis that a third version with the wording "Yellow" on the first button and the wording "Red" on the second button, would eventually generate many more actions.

This is confirmed in a third version of the menu, which now generates 88% of actions on the buttons, thanks to an optimization linked in real time to A/B Testing statistics of BOTNATION, and the possibility to include several elements in rotation.

Reset your AB Testing

For some reason, you might want to erase your previous statistics to have new ones. For instance, if you modified totally your chatbot after having analyzed your whole metrics, then you may need to delete the previous figures to obtain new ones.

In this case, go to the Settings tab, then "Advanced settings". The box "Reinitialization of AB testing" allows you to delete the previous figures. Click on "Permanently delete data from AB testing".

Now that you have all this information, may you obtain excellent optimizations of your chatbot in BOTNATION!

Recommended reading

To find out more about smart tips, visit: Get To Know Everything There Is About Variables