Cookie policy: This site uses cookies (small files stored on your computer) to simplify and improve your experience of this website. Cookies are small text files stored on the device you are using to access this website. For more information on how we use and manage cookies please take a look at our privacy and cookie policies. Some parts of the site may not work properly if you choose not to accept cookies.

sections
Home > Optimizely > The Surprising Power of Online Experiments
 

The Surprising Power of Online Experiments

White Paper Published By: Optimizely
Optimizely
Published:  Apr 06, 2018
Type:  White Paper
Length:  4 pages

Getting the most out of A/B and other controlled tests.

In the fast-moving digital world, even experts have a hard time assessing new ideas. Case in point: At Bing a small headline change an employee proposed was deemed a low priority and shelved until one engineer decided to do a quick online controlled experiment—an A/B test—to try it out. The test showed that the change increased revenue by an astonishing 12%.

That experience illustrates why it’s critical to adopt an “experiment with everything” approach, say Ron Kohavi, the head of the Analysis & Experimentation team at Microsoft, and Stefan Thomke, an HBS professor.

In this article they describe: How to properly design and execute A/B and other controlled tests

? Ensure test integrity
? How to interpret results and avoid pitfalls



Tags :