3 years ago

In this minisode Kyle and Linh Da discuss the meaning of Bayesian Updating.

The root concept is Bayes Theorem:

Although a more helpful way of thinking about this alongside our discussion is to replace with for Hypothesis, and with for Evidence.In this case would represent your \emph{prior} probability / belief representing the likelihood that the hypothesis is true. Given new evidence , you can evaluate how likely that hypothesis was to generate that Evidence (i.e. ).

In our farmers market example, we had...

- - Box contains 100\% (P)omegranates
- - Box contains (M)ix of 50\% pomegranates and 50\% lemons
- - Box contains 100\% (L)emons

We established our prior beliefs as for .

When the farm pulls out one example fruit which turns out to be a pomegranate, Linh Da points out that ``it's not the bad of just lemons'' (a.k.a. ). But that doesn't mean the other hypothesis are not 50 / 50! What are they?

If you're having a hard time understanding why , it's because this is your expectation of the evidence you got independent of which hypothesis turns out to be true. Thus, it's based on your prior (original) belief over each hypothesis and their likelihood of producing the observation. In other words...

Enjoy this post? Sign up for our mailing list and don't miss any updates.