Turn on suggestions

Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

- JMP User Community
- :
- Discussions
- :
- Discussions
- :
- How reliable is post hoc means comparison in anova with unequal variance?

Topic Options

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

How reliable is post hoc means comparison in anova with unequal variance?

Oct 4, 2016 7:25 AM
(1523 views)

In the attached data, I want to do an ANOVA analysis with MathSS as Y, and School Name as X. The variance between groups are not equal, after the "unequal variance" test. Can I still proceed with means comparison such as HSD Tukey? How reliable is this post hoc test? Thank you so much!

1 REPLY

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: How reliable is post hoc means comparison in anova with unequal variance?

I am going to make the assumption that you wish to understand the similarities and differences between the schools for the various test score that you have. I would do some or all of the following:

Use distribution to look at scores by school. Most schools have a few really good test takers but you are probably more interested in what the middle part of the distribution looks like.

Use graph builder to explore the data. Here is a busy GB that I would use as an exploratory tool - I would simplify before sharing (copy to a new script and with your data table open run the script)

Graph Builder(

Size( 880, 544 ),

Variables( X( :School Name ), Y( :MathSS ) ),

Elements(

Box Plot( X, Y, Legend( 7 ) ),

Points( X, Y, Legend( 8 ) ),

Line( X, Y, Legend( 9 ), Summary Statistic( "Median" ) ),

Contour( X, Y, Legend( 10 ) )

),

SendToReport(

Dispatch( {}, "Graph Builder", FrameBox, {Marker Size( 2 )} ),

Dispatch( {}, "400", LegendBox, {Set Title( "" )} )

)

);

Use the Fit Y by X platform to explore as you have started to do. Use the quantiles option to compare the quantiles (important measures for test scores - in my opinion), consider non-parametric tests if you must have p-values. Consider the ANOM with transformed ranks to compare across all schools.