What is A/A test?

An A/A test is an experiment where two groups of users receive the same version of a product or interface. The goal of an A/A test is to verify the correctness of the system setup for conducting A/B tests, ensure that metrics and data collection are working properly, and that there are no systematic differences between the groups.

For example, if the results of two groups in an A/A test differ significantly, it may indicate issues with randomization, data collection, or external factors affecting the experiment.

Thus, an A/A test serves to validate the experiment before launching a real A/B test.