loglikelihood not available

Welcome to the forum for REALCOM users. Feel free to post your question about REALCOM here. The Centre for Multilevel Modelling take no responsibility for the accuracy of these posts, we are unable to monitor them closely. Do go ahead and post your question and thank you in advance if you find the time to post any answers!

Go REALCOM (Developing multilevel models for REAListically COMplex social science data) >> http://www.bristol.ac.uk/cmm/software/realcom/
Post Reply
arthur11
Posts: 6
Joined: Wed Aug 14, 2013 2:41 pm

loglikelihood not available

Post by arthur11 » Wed Aug 14, 2013 3:11 pm

Hello,
I am just getting started with multiple imputation and so as with MlwiN and RealCom.
I followed the tutorial example given in the RealCom manual, but things don't go exactly as they should (at least, my problems are not mentioned in the tutorial).
First, once I start the imputation analysis, I always get the message: "the columns below contain numerical data that cannot be precisely stored in the single precision format used by MLwiN (...)", asking if I want to convert them in categorical variables. I get this message as many times as my number of imputations, so it is a bit annoying... Is there anything I could do to avoid that?
Even though I get pretty much the same estimates than in the tutorial, another thing that I don't get is why it always says "loglikelihood not available", whereas in the tutorial you should get a value.
Thank you in advance for your help!

ChrisCharlton
Posts: 1132
Joined: Mon Oct 19, 2009 10:34 am

Re: loglikelihood not available

Post by ChrisCharlton » Wed Aug 14, 2013 3:38 pm

Unfortunately the only ways to avoid the single precision message would be one of the following:
I believe that the reason that you don't get a likelihood for you model of interest is that these estimates are created from combining a number of different model runs (one for each imputed data set) and combining the likelihoods in the same way wouldn't make sense.

arthur11
Posts: 6
Joined: Wed Aug 14, 2013 2:41 pm

Re: loglikelihood not available

Post by arthur11 » Wed Aug 14, 2013 4:00 pm

Thanks a lot for answering so quickly.
I guess in the tutorial only a single imputation was made.
One more question: do you have any idea why my imputation specification goes well with the menu, but not with the command lines? The ISAVE and IRETRIEVE commands produce error messages (Li| type).
Thanks again

ChrisCharlton
Posts: 1132
Joined: Mon Oct 19, 2009 10:34 am

Re: loglikelihood not available

Post by ChrisCharlton » Wed Aug 14, 2013 4:11 pm

I'm not sure why that would be, however the menus should generate the appropriate commands. You can check this by opening the Data Manipulation->Command Interface window and unticking "user". When you use the menus the generated commands should appear in this window, allowing you to compare them with the version that you are using.

zahra777
Posts: 15
Joined: Mon Feb 03, 2014 1:39 am

Re: loglikelihood not available

Post by zahra777 » Sat Feb 22, 2014 10:36 pm

Hi,

I am following the same Realcom Impute tutorial and have the same problem.

I believe the tutorial uses 5 imputations and I do get the same errors.
2loglikelihood is unavailable whereas in the tutorial it has a value!

My coefficient values are different from the tutorial as well. Any idea why that is the case?
Many thanks in advance!

Zahra

ChrisCharlton
Posts: 1132
Joined: Mon Oct 19, 2009 10:34 am

Re: loglikelihood not available

Post by ChrisCharlton » Mon Feb 24, 2014 12:27 pm

The screenshot in the tutorial is from an older version of MLwiN. The likelihood in the tutorial will just be the value from the last imputed model of interest, you will also notice that the "cases in use" matches the original data whereas the models run on the imputed data in fact use all cases in the data. Later versions of MLwiN remove this line for these reasons. I am not sure why you are getting different coefficient values, are they very different?

zahra777
Posts: 15
Joined: Mon Feb 03, 2014 1:39 am

Re: loglikelihood not available

Post by zahra777 » Wed Feb 26, 2014 12:11 am

Hi Chris,

Thanks for your reply
Now I know why there is a loglikelihood value in the tutorial!
My values are not too different from the tutorial values but then again tutorial values are not so different from before imputation values, so I am not sure.
I have attached the models before imputation, after imputation ( tutorial values) and my work after imputation respectively. Do you think my values show that I have performed multiple imputation correctly?


Many thanks!
Zahra
Attachments
models.docx
(75.81 KiB) Downloaded 271 times

ChrisCharlton
Posts: 1132
Joined: Mon Oct 19, 2009 10:34 am

Re: loglikelihood not available

Post by ChrisCharlton » Wed Feb 26, 2014 1:45 pm

Running through the tutorial I get the same answers as you using the most recent version of Realcom-Impute, so I suspect that the differences are just due to updates to Realcom-Impute since the tutorial document was written.

zahra777
Posts: 15
Joined: Mon Feb 03, 2014 1:39 am

Re: loglikelihood not available

Post by zahra777 » Thu Aug 14, 2014 11:14 pm

Hello,

Since the value for loglikelihood is not available after performing multiple imputation using Realcom, how can one comment on model fit of the imputed data?

Many thanks,
Zahra

zahra777
Posts: 15
Joined: Mon Feb 03, 2014 1:39 am

Re: loglikelihood not available

Post by zahra777 » Sun Aug 17, 2014 6:52 pm

Hi all,

My question is how to compare goodness of fit of nested models when log likelihood is not available (after multiple imputation using Realcom)

Many thanks

Zahra

Post Reply