A term used to describe test methods or algorithms that continuously shift traffic in reaction to the real-time performance of the test.
Confidence Interval: A range of values calculated such that there is a known probability that the true mean of a parameter lies within it.
Confidence Level: The percentage of time that a statistical result would be correct if you took numerous random samples.
Margin of Error: An expression for the maximum expected difference between the true population parameter and a sample estimate of that parameter.
Sample Size: The number (n) of observations taken from a population through which statistical inferences for the whole population are made.
The debating, campaigning and speculating will soon be over. In just a few short weeks, our new President will be elected. Somehow, through this long and arduous process, the parallels between website A/B testing and the election became apparent to me as the campaign continued to grind on.
The concept of perfection is an interesting one. Like infinity, it represents something that can never truly exist, yet most of us talk about it as if it does. How often have you heard a friend or coworker say they don’t want to put their name on anything that is…
They say you can never have too much of a good thing. When it comes to time, money and friendship, I completely agree.
In website testing for CRO, most things are pretty definitive. Did a customer visit convert into a sale or not? Was it A or B, yes or no, win or lose? The simplicity makes data both easy to collect and easy to analyze. But are we missing out on something…