A/B Testing

An experiment that shows two variants of a page or feature to randomly split groups of users, and compares a chosen metric to learn which performs better

It is a randomized controlled trial, so it answers which variant, not why. Decide the metric and sample size before looking at results. Stopping as soon as a difference appears is the classic way to ship noise. Multivariate testing varies several elements at once.