Page **1** of **2**

### Error when running 2-level ordinal model in R2wiN

Posted: **Tue Sep 26, 2017 2:47 pm**

by **divasong**

Dears,

I have encountered a problem when running a 2-level ordinal model in R2wiN. Below is the expression I used in R:

(mymodel <- runMLwiN(logit(Relief, cons) ~ 1 + (1 | District) , D = "Ordered Multinomial", estoptions = list(EstM = 1, nonlinear = c(1, 2), resi.store = TRUE), data = try))

Here Relief is an ordered response with a range of [1:5], and District stores the names of group at level-2.

When I try to run this code, a window named "Error detected by MLN". And it says

"error while obeying batch file C:/Users/Diva~1/AppData/Local/Temp/RtmpgnO85h/macrofile_411c5ed77ee3.txt at line number 79:

NeXT

design vector at level 2 is the wrong length."

And when I clicked the OK at that window, in R, it shows

"Error in read.dta(chainfile*) : *

unable to open file: 'No such file or directory"

Just want to know what happened during this procedure. I have checked that there is no missing value in my dataset.

Looking forward for your reply.

Diva

### Re: Error when running 2-level ordinal model in R2wiN

Posted: **Tue Sep 26, 2017 3:19 pm**

by **ChrisCharlton**

Do you get the same error if you try different **nonlinear** options?

In MLwiN versions prior to 3.01 it would replace very small residual values with the missing code, which could sometimes cause similar problems. I would suggest updating to this version if you haven't already to see if you get the problem there too.

Another thing to try would be to change the base category to see whether this makes estimation any more successful.

### Re: Error when running 2-level ordinal model in R2wiN

Posted: **Wed Sep 27, 2017 7:58 am**

by **divasong**

Thanks for your answer. The problem is solved. It may be caused by some duplicated level-2 items. Just wander if there is some function I could used in R to do the hierarchy viewer like in MLwiN. Thanks.

Diva

### Re: Error when running 2-level ordinal model in R2wiN

Posted: **Wed Sep 27, 2017 9:14 am**

by **ChrisCharlton**

If you just want the number of units at each level, along with the minimum, maximum and mean number of records within each unit then this is already reported in the R2MLwiN output, as well as being available in the

**@Hierarchy** slot of the model object.

If you would like more detailed information then you could adapt the code that calculates above information. This can be found at the following location in the runMLwiN.R file:

https://github.com/rforge/r2mlwin/blob/ ... iN.R#L2673.

### Re: Error when running 2-level ordinal model in R2wiN

Posted: **Wed Sep 27, 2017 10:49 am**

by **divasong**

Thank you for your comments. I have tried to run the model using MCMC, but it shows EESs are all very small with respect to iteration number (5000) although I used orthogonal parameterization. The result is showed as below. And just wander if there is some method to improve the mixing.

MLwiN (version: 2.36) multilevel model (Multinomial)

N min mean max N_complete min_complete mean_complete max_complete

DISTRICT 115 2 8.808696 25 115 2 8.808696 25

Estimation algorithm: MCMC Elapsed time : 21.07s

Number of obs: 1013 (from total 1013) Number of iter.: 5000 Chains: 1 Burn-in: 500

Bayesian Deviance Information Criterion (DIC)

Dbar D(thetabar) pD DIC

2589.358 2487.432 101.925 2691.283

---------------------------------------------------------------------------------------------------

The model formula:

logit(Y, cons, 5) ~ 1 + (1[1:4] | DISTRICT)

Level 2: DISTRICT Level 1: l1id

---------------------------------------------------------------------------------------------------

The fixed part estimates:

Coef. Std. Err. z Pr(>|z|) [95% Cred. Interval] ESS

Intercept_1 -1.55175 0.18080 -8.58 9.263e-18 *** -1.92694 -1.22738 50

Intercept_2 0.12467 0.17880 0.70 0.4857 -0.22464 0.46970 39

Intercept_3 1.04400 0.18617 5.61 2.048e-08 *** 0.68504 1.41288 45

Intercept_4 2.60164 0.20323 12.80 1.609e-37 *** 2.21325 3.01465 52

Signif. codes: 0 '***' 0.001 '**' 0.01 '*' 0.05 '.' 0.1 ' ' 1

---------------------------------------------------------------------------------------------------

The random part estimates at the DISTRICT level:

Coef. Std. Err. [95% Cred. Interval] ESS

var_Intercept_1234 2.78119 0.50209 1.92571 3.88142 594

---------------------------------------------------------------------------------------------------

The random part estimates at the l1id level:

Coef. Std. Err. [95% Cred. Interval] ESS

bcons_1 1.00000 1e-05 1.00000 1.00000 5000

### Re: Error when running 2-level ordinal model in R2wiN

Posted: **Wed Sep 27, 2017 11:26 am**

by **ChrisCharlton**

As your example model only contains an intercept term the orthogonal parameterisation option will make no difference in this case.

Have you looked at the traces of your parameter chains to see whether they look like they have converged to a distribution? If so it may just be that you need to increase the number of iterations to get to the ESS values that you want.

### Re: Error when running 2-level ordinal model in R2wiN

Posted: **Thu Sep 28, 2017 2:58 am**

by **divasong**

Thanks for your answer. I will try to increase the iteration number or build up more chains. Another problem is that for the new version of R2MLwiN, is there any function I could use to test the proportional odds assumption? And is it possible to compare two models estimated by IGLS (PQL2).

Regards.

Jinglu

### Re: Error when running 2-level ordinal model in R2wiN

Posted: **Thu Sep 28, 2017 8:56 am**

by **ChrisCharlton**

Regarding testing the proportional odds assumption the answer given at

https://www.cmm.bristol.ac.uk/forum/viewtopic.php?t=771 should also apply to R2MLwiN.

To compare the two discrete models fit using IGLS you could perform a Wald test using the

**linearHypothesis** function provided by R. For an example of this see chapter 9 of the MLwiN manual examples:

http://www.bristol.ac.uk/cmm/media/r2ml ... rGuide09.R.

### Re: Error when running 2-level ordinal model in R2wiN

Posted: **Thu Sep 28, 2017 2:46 pm**

by **divasong**

Thanks a lot. It's very useful and is just what I want.

Diva

### Re: Error when running 2-level ordinal model in R2wiN

Posted: **Fri Sep 29, 2017 9:55 am**

by **divasong**

Hello!

I have used the linearHypothesis to check the proportional odds (PO) assumption in my 2-level model.

**Result of Wald test using linearHypothesis:**

.......................chisq.........Pr(>Chisq)......

FP_Age2_1234 6.311407258 0.097404346

FP_Age3_1234 11.96573783 **0.007501455**

FP_Age4_1234 9.438055025 **0.023999565**

And the testing result shows that, for an ordinal variable (Age: levels 1<2<3<4), FP_Age**3**_1234 and FP_Age**4**_1234 show significantly difference between the proportional-odds cumulative logit model and the separate cumulative logit model. However, when I check their effects on response variable, there is no significant effects. On this condition, just wander whether I should treat them with common coefficient or with separate coefficients, or even just drop this insignificant variable (My focus is on the effects of group-level variables). And if I need to add them into the model with separate coefficients, how can I only make FP_Age3_1234 and FP_Age4_1234 with separate coefficients rather than FP_Age_1234 (the whole Age variable) in R2MLwiN.

The model results of the proportional-odds cumulative logit model (Table1) and of the separate cumulative logit model (Table2) are shown in the attachment.

Thanks and regards.

Diva