Why you should try the Bayesian approach of A/B testing

"Critical thinking is an active and ongoing process. It requires that we all think like Bayesians, updating our knowledge as new information comes in." ― Daniel J. Levitin, A Field Guide to Lies: Critical Thinking in the Information Age Before we delve into the intuition behind using the Bayesian approach of estimation, we need to understand a few concepts. Inferential statistics is when you infer something about a whole population based on a sample of that population, as opposed to descriptive statistics which describes something about the whole population. When it comes to inferential statistics, there are two main philosophies: frequentist inference and Bayesian inference. The frequentist approach is known to be the more traditional approach to statistical inference, and thus studied more in most statistics courses (especially introductory courses). However, many would argue that the Bayesian approach is much closer to the way humans naturally perceive probability.