cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
JMP is taking Discovery online, April 16 and 18. Register today and join us for interactive sessions featuring popular presentation topics, networking, and discussions with the experts.
Choose Language Hide Translation Bar
amm9010
Level I

Should I use Bonferroni correction when making two linear contrasts with Fit Model?

I'm conducting a series of univariate REML models and have two preplanned orthogonal contrasts. I am wondering if I need to correct the acceptable alpha to guard against Type I error, or if this correction is taken into consideration by the JMP program when I add a second contrast?

2 ACCEPTED SOLUTIONS

Accepted Solutions
jiancao
Staff

Re: Should I use Bonferroni correction when making two linear contrasts with Fit Model?

JMP doesn't automatically make the adjustment when you use Custom Test from the Estimates menu to add additional contrasts. You may apply the Bonferroni correction. (As a note, when there are a large number of comparisons, the Bonferroni correction can be too conservative.)

View solution in original post

dr_winfried_koc
Level III

Re: Should I use Bonferroni correction when making two linear contrasts with Fit Model?

A slightly less conservative option is the Bonferroni-Holm procedure:  the smaller p value needs to be tested on the alpha/2 level first, the other p value can then be tested on your planned  alpha level if the first test was statistically significant.

A further option for dealing with the multiple testing issue is the false discovery rate approach (FDR-approach) for which a nice and easy usable JMP Add-In is available.

View solution in original post

4 REPLIES 4
jiancao
Staff

Re: Should I use Bonferroni correction when making two linear contrasts with Fit Model?

JMP doesn't automatically make the adjustment when you use Custom Test from the Estimates menu to add additional contrasts. You may apply the Bonferroni correction. (As a note, when there are a large number of comparisons, the Bonferroni correction can be too conservative.)

dr_winfried_koc
Level III

Re: Should I use Bonferroni correction when making two linear contrasts with Fit Model?

A slightly less conservative option is the Bonferroni-Holm procedure:  the smaller p value needs to be tested on the alpha/2 level first, the other p value can then be tested on your planned  alpha level if the first test was statistically significant.

A further option for dealing with the multiple testing issue is the false discovery rate approach (FDR-approach) for which a nice and easy usable JMP Add-In is available.

jiancao
Staff

Re: Should I use Bonferroni correction when making two linear contrasts with Fit Model?

Thanks for mentioning the FDR Pvalue add-in. It has been incorporated into JMP known as the Response Screening under Modeling.

amm9010
Level I

Re: Should I use Bonferroni correction when making two linear contrasts with Fit Model?

Thanks so much for the suggestions, that all definitely helps!