Turn on suggestions

Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

- JMP User Community
- :
- Discussions
- :
- Discussions
- :
- Should I use Bonferroni correction when making two linear contrasts with Fit Mod...

Topic Options

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Mar 29, 2016 6:35 AM
(3301 views)

I'm conducting a series of univariate REML models and have two preplanned orthogonal contrasts. I am wondering if I need to correct the acceptable alpha to guard against Type I error, or if this correction is taken into consideration by the JMP program when I add a second contrast?

2 ACCEPTED SOLUTIONS

Accepted Solutions

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

JMP doesn't automatically make the adjustment when you use *Custom Test* from the *Estimates* menu to add additional contrasts. You may apply the Bonferroni correction. (As a note, when there are a large number of comparisons, the Bonferroni correction can be too conservative.)

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

A slightly less conservative option is the Bonferroni-Holm procedure: the smaller p value needs to be tested on the alpha/2 level first, the other p value can then be tested on your planned alpha level if the first test was statistically significant.

A further option for dealing with the multiple testing issue is the false discovery rate approach (FDR-approach) for which a nice and easy usable JMP Add-In is available.

4 REPLIES

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

*Custom Test* from the *Estimates* menu to add additional contrasts. You may apply the Bonferroni correction. (As a note, when there are a large number of comparisons, the Bonferroni correction can be too conservative.)

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

A slightly less conservative option is the Bonferroni-Holm procedure: the smaller p value needs to be tested on the alpha/2 level first, the other p value can then be tested on your planned alpha level if the first test was statistically significant.

A further option for dealing with the multiple testing issue is the false discovery rate approach (FDR-approach) for which a nice and easy usable JMP Add-In is available.

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: Should I use Bonferroni correction when making two linear contrasts with Fit Model?

Mar 31, 2016 5:25 PM
(3106 views)
| Posted in reply to message from dr_winfried_koc 03/31/2016 11:43 AM

Thanks for mentioning the FDR Pvalue add-in. It has been incorporated into JMP known as the Response Screening under Modeling.

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: Should I use Bonferroni correction when making two linear contrasts with Fit Model?

Thanks so much for the suggestions, that all definitely helps!