Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

- JMP User Community
- :
- Discussions
- :
- two way anova with strongly unbalanced samples

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

Highlighted

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Jul 17, 2020 7:55 AM
(554 views)

In case like this, where the two sample sizes are so strongly different (25 vs 410), the standard anova test is it ok?

1 ACCEPTED SOLUTION

Accepted Solutions

Highlighted

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Use the Unequal Variance command in the Oneway platform menu. It will not only provide several hypothesis tests for the variance but also the Walsh ANOVA for the cases with unequal variances.

Learn it once, use it forever!

6 REPLIES 6

Highlighted
##

I assume you mean the F-test? Before doing any quantitative statistical test I would examine the data for unusual data points (special or assignable). Understand these first before doing any quantitative test. It looks to me as the means are about the same, but the variances of the 2 groups are different. I have no context for the scale, so I don't know if the variation in those values is of any practical significance. The MSE will be estimated by the average of the variances of the 2 groups. In this case, that variance will likely be large, so the test of differences will likely yield no significant difference between the mean of the 2 groups.

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: two way anova with strongly unbalanced samples

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: two way anova with strongly unbalanced samples

Just to add, whether to believe those results or whether those results can be extrapolated is largely a function of how the data was acquired and how representative those data sets are of the future.

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: two way anova with strongly unbalanced samples

I means the pval. In this case it is not significant with 95% CL. But I can believe it? I saw other cases like this with strong unbalanced sample with a pval lower than 0.01. You are rogth. The "Yes" group has a large variance than "No " group. So in this case which the best method to compare the 2 groups? Big difference in variance and in sample sizes.

Felice

Felice

Highlighted

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Use the Unequal Variance command in the Oneway platform menu. It will not only provide several hypothesis tests for the variance but also the Walsh ANOVA for the cases with unequal variances.

Learn it once, use it forever!

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: two way anova with strongly unbalanced samples

Created:
Jul 17, 2020 10:27 AM
| Last Modified: Jul 17, 2020 10:28 AM
(535 views)
| Posted in reply to message from FR60 07-17-2020

The difference in the sample size of the two groups does not matter, except that it inflates the variance of the parameter estimates. (Yes, there is an ANOVA model.)

You need to check the assumptions of the ANOVA to decide if the inference is valid.

- Observations are independent (no auto-correlation).
- Errors are normally distributed.
- Variance is constant across groups. The only difference is the mean.

Looks like you severely violate at least two of the assumptions, so you should not use ANOVA.

Learn it once, use it forever!

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: two way anova with strongly unbalanced samples

Thanks Mark. So in that case which is the best model to compare the 2 groups?

F.

F.