What are the most interesting and counter-intuitive results you have seen from an A/B test?

During the Obama campaign we ran a bunch of A/B tests and were constantly surprised by the results.

One example is the experiment we ran on the splash page (the page visitors see the first time they came to barackobama.com). We tried three different images and three different videos and the crowd favorite lost by a land slide. I don't want to give away the surprise but you can see all the variations and the results in my talk at Stanford:

It was actually my experience during the Obama campaign that inspired me to start Optimizely: http://ift.tt/ecfZUR/, a dramatically easier way to improve your website through A/B testing. We're building the product I WISH we had during the campaign.

Read other answers by

Dan Siroker on Quora:

• What is the motivation for Optimizely to ask for a credit card at the last step?

Read more answers on Quora.

from Quora http://ift.tt/2eo2wP2