Split decision – what to consider when conducting an A/B test

Split decision – what to consider when conducting an A/B test

Which of these statements about A/B testing is correct? A. It’s a fun little experiment. B. It’s a powerful tool which must be handled correctly. The correct answer is B. Split testing is a powerful tool. And, like all tools, it has the potential to do more harm than good if it’s not operated with care. It’s therefore unfortunate that split testing is often treated more like option A. "Hey, let’s try this" says someone… and suddenly you’re conducting an experiment based on an arbitrary, last-minute decision. Testing in a haphazard and disjointed manner may garner useful insights into your customers’ behaviour but it’ll be mostly down to luck. Such unplanned testing is as likely to waste time on inconclusive,…