cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Try the Materials Informatics Toolkit, which is designed to easily handle SMILES data. This and other helpful add-ins are available in the JMP® Marketplace
Choose Language Hide Translation Bar
lconley20
lconley20
Level I

Comparing multiple means using one way ANOVA when variances are unequal

Dec 7, 2016 08:37 AM (9936 views)

I have 3 data sets  and performed One way ANOVA to see if means  between group are different. The ANOVA for the P-value is 0.13 and shows  there is no significant difference between means, but the four test for equal variance  test O'Brein, Brown-Forsyhe Levene and Barrlett have   p-value equal to or less than 0.00723. This indicates variances are not equal. The Welch's ANOVA test also has a low p-value 0.0123. Since the variance are unequal is the Welch's Test is the appropriate test for showing at least one the group  means is different from the others since variances are unequal? I believe the Tukey-Kramer test would have been the appropriate if varainace are equal. Is there an eqaulivalent test if variances are unequal?

0 Kudos
1 ACCEPTED SOLUTION

Accepted Solutions
Peter_Bartell
Peter_Bartell
Level VIII
Solution

Re: Comparing multiple means using one way ANOVA when variances are unequal

Dec 7, 2016 09:22 AM (12155 views)  |  Posted in reply to message from lconley20 12-07-2016

A few thoughts for you:

 

First off, try to avoid using p values as a 'cliff' indicating 'signficance' but more as a measure of probability of getting a test statistic at least as large due solely to chance. Additionally, what do your eyes tell you about group means when looking at the Fit Y by X scatter plot? And most importantly can domain expertise help inform your ultimate decision? What are the risks (practical not statistical) for making a wrong decision regarding groups? These should help guide your ultimate decision AT least as much as a p value.

 

Lastly, if you are bound and determined to use something that produces p values or their brethren in a multiple comparison mode, maybe take a look at the nonparametric multiple comparison tests? These are offered as a hot spot option from the Fit Y by X platform report under Nonparametric -> Nonparametric multiple comparisons. 

View solution in original post

1 REPLY 1
Peter_Bartell
Peter_Bartell
Level VIII
Solution

Re: Comparing multiple means using one way ANOVA when variances are unequal

Dec 7, 2016 09:22 AM (12156 views)  |  Posted in reply to message from lconley20 12-07-2016

A few thoughts for you:

 

First off, try to avoid using p values as a 'cliff' indicating 'signficance' but more as a measure of probability of getting a test statistic at least as large due solely to chance. Additionally, what do your eyes tell you about group means when looking at the Fit Y by X scatter plot? And most importantly can domain expertise help inform your ultimate decision? What are the risks (practical not statistical) for making a wrong decision regarding groups? These should help guide your ultimate decision AT least as much as a p value.

 

Lastly, if you are bound and determined to use something that produces p values or their brethren in a multiple comparison mode, maybe take a look at the nonparametric multiple comparison tests? These are offered as a hot spot option from the Fit Y by X platform report under Nonparametric -> Nonparametric multiple comparisons.