Correcting for type 1 error in mlwin

Welcome to the forum for MLwiN users. Feel free to post your question about MLwiN software here. The Centre for Multilevel Modelling take no responsibility for the accuracy of these posts, we are unable to monitor them closely. Do go ahead and post your question and thank you in advance if you find the time to post any answers!

Remember to check out our extensive software FAQs which may answer your question: http://www.bristol.ac.uk/cmm/software/s ... port-faqs/
Post Reply
SibelHalfon
Posts: 3
Joined: Fri May 24, 2024 4:20 pm

Correcting for type 1 error in mlwin

Post by SibelHalfon »

I have multiple outcome measures from the same patients and have to run multiple simultaneous analyses on the same data. Is there some way I can correct for type 1 error (eg using a different estimator than igls) or some other way to adjust for this? I don't want to do a Bonferroni correction because it is too conservative for my data.

Many thanks
Last edited by SibelHalfon on Sat May 25, 2024 8:22 am, edited 1 time in total.
SibelHalfon
Posts: 3
Joined: Fri May 24, 2024 4:20 pm

Re: Correcting for type 1 error in miwin

Post by SibelHalfon »

Just to explain my data I have three levels where outcome measures are nested in patients who are further nested in clinicians. The measures are collected repeatedly over 5 time points. I am interested in assessing whether there is a differential change in outcome based on treatment type.
billb
Posts: 163
Joined: Fri May 21, 2010 1:21 pm

Re: Correcting for type 1 error in mlwin

Post by billb »

I would imagine if you don't want to do Bonferroni then you could try something like Benjamini & Hockberg's FDR which is less conservative (false discovery rate) and I believe could be used for most models. Don't think there is an estimation procedure related approach like tweaking IGLS here.
SibelHalfon
Posts: 3
Joined: Fri May 24, 2024 4:20 pm

Re: Correcting for type 1 error in mlwin

Post by SibelHalfon »

Thank you so much.

Would you suggest bootstrapping in this case? I know it does not directly address type 1 error but can provide more accurate estimates and confidence intervals?
billb
Posts: 163
Joined: Fri May 21, 2010 1:21 pm

Re: Correcting for type 1 error in mlwin

Post by billb »

Not for fixing the issue of multiple comparisons as bootstrapping will not help with that.
Post Reply