6.1 Motivation for approximations
- Remember we are trying to compute the posterior distribution:
\[ f\left(\theta | y \right) = \frac{f(\theta)L(\theta | y)}{f(y)} \]
In previous examples (conjugate priors) we were able to do this analytically
Numerator - no issue, we specify these distributions.
Denominator - Can be difficult or intractable to compute the denominator f(y) !
\[ f(y) = \int_{\theta_1}\int_{\theta_2} ... \int_{\theta_k}f(\theta)L(\theta | y) d\theta_k ... d\theta_1 d\theta_2 \]
- Solution? Approximate the posterior via simulation!