How valid are AB comparisons?

Subscribe to Ask Paul Ask a Question

What happens when you do AB comparisons? Are they as simple as they seem or are they more complicated? What are the pitfalls to watch out for with AB comparisons?