p values for confidence intervals vs. credible intervals

Welcome to the forum for runmlwin users. Feel free to post your question about runmlwin here. The Centre for Multilevel Modelling take no responsibility for the accuracy of these posts, we are unable to monitor them closely. Do go ahead and post your question and thank you in advance if you find the time to post any answers!

Go to runmlwin: Running MLwiN from within Stata >> http://www.bristol.ac.uk/cmm/software/runmlwin/
Post Reply
lizrichardson
Posts: 4
Joined: Fri Jan 24, 2014 1:59 pm

p values for confidence intervals vs. credible intervals

Post by lizrichardson »

Hi,

I'm new to MCMC models but am finding runmlwin a very helpful and flexible way to use MLwiN. Also this forum is a wealth of great advice for a newbie. Thanks for all the contributions.

My query is about p values. A p value is given by default when I run my model, but I'm not sure how to interpret it. I started to suspect that this isn't like a frequentist p-value when I got a p=0.049 for a credible interval that included zero. If I add the zratio option I get a pa value that make more sense to me for the same CI: p=0.106 rather than p=0.049. I know that confidence intervals and credible intervals aren't the same thing, and that p values are frowned upon by Bayesians, so I'm wondering how to proceed with the interpretation.

Thanks,

Liz
ChrisCharlton
Posts: 1384
Joined: Mon Oct 19, 2009 10:34 am

Re: p values for confidence intervals vs. credible intervals

Post by ChrisCharlton »

The Bayesian p-values are calculated as the proportion of the chain where the values are of the opposite sign to that of the corresponding estimate (usually the mean). This is one-tailed, which is why it is approximately half the value you obtained via the zratio option.
lizrichardson
Posts: 4
Joined: Fri Jan 24, 2014 1:59 pm

Re: p values for confidence intervals vs. credible intervals

Post by lizrichardson »

Many thanks for the reply Chris.

Liz
Post Reply