Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

- JMP User Community
- :
- Discussions
- :
- Standard t-test across many samples with a single ...

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Aug 14, 2017 6:44 PM
(591 views)

6 REPLIES

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Aug 14, 2017 7:56 PM
(584 views)

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Aug 15, 2017 5:45 AM
(572 views)

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Aug 15, 2017 9:45 AM
(562 views)

Based on the way you have your data set up, Dunnet's with control in Fit Y by X is your only option. Why would you not want to use Dunnet's with control? That option seems like the most appropriate option for your data. How many comparisons are you making where you think an FDR would be needed?

Chris

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Aug 15, 2017 9:53 AM
(560 views)

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Aug 15, 2017 10:22 AM
(554 views)

Yes, it is true that Dunnet's does look at the family-wise error rate and hold it below alpha when making the comparisons. But so does Tukey, Bonferroni, and others. It is likely more conservative than Benjamini-Hochberg FDR, but less conservative than Bonferroni. I think it also matters how many comparisons are being made. I think with a large number of comparisons, Benjamini-Hochberg FDR seems reasonable and not so aggressive from a screening point of view, but for a small number of comparisons, maybe a little aggressive as well.

As for using Student's t-Test for the compare means option, here is some tricks you can use to get what you want.

One trick that may help you if you want to use student's t-test and only look at the control comparisons. At the bottom of the report, look for the ordered differences report. You can right click on it and choose Make into a Data Table. There, you can sort by level and remove the rows that do not have the comparisons you want. Here is another trick, if you use the value ordering property of a column, you can have the control level on the top of the list. This will help with the ordered difference report so that you can more easily get to the comparisons with the control.

To this new table, you can then create a new columns with the FDR formula so you can correct the p-values.

In the end, there will be those comparisons that are on the edge of your decision line (cutoff) and those should probably be included anyway. It is screening, so have a few more doesn't hurt. That p-value and cutoff line are a nice guide to narrow down what to focus on, but shouldn't be used to rigidly for screening purposes. There has to be practical considerations included in the decision making process as well (how many of the comparisons can be practically followed up on)

Hope this helps.

Chris

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Aug 17, 2017 9:22 AM
(467 views)