User Community
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • Instantly extract effect sizes, F-ratios, and FDR-adjusted p-values from your models with the Calculate Effects Sizes extension, available now in the JMP Marketplace!
  • New to JMP? Join us Sept. 23-24 for the Early User Edition of Discovery Summit, tailor-made for new users. Register now for free!
  • See how to use the JMP Marketplace – Free tools to expand JMP capabilities. Register. July 10, 2 pm US Eastern Time.

JMP Wish List

We want to hear your ideas for improving JMP. Share them here.
Choose Language Hide Translation Bar

Add superiority test to oneway analyses indicating the probability of being superior by different margins.

Status: New Submitted by Super User (Alumni) on ‎10-06-2021 10:34 AM
Comment

Add a test to produce p values of superiority tests at a range of distances and output those to a table or graph as shown below.

 

ih_1-1633695166276.png

Consider a trial where a process change is made.  Results are compared with current performance and a t test determines that the process was improved (the mean shifted) with a p-value of 0.05 and a superiority test in JMP 17 indicates that the mean shifted by at least 0.01 with a p value of 0.12, but neither tells a whole story.  To make an informed decision, we would want to know information like:

  • 5% chance the process stayed the same or got worse
  • 90% chance the process improved by at least 0.01
  • 50% chance the process improved by at least 0.006
  • 5% change the process improved by at least 0.011

Here is a post with two potential methods of calculating these values:

Compare means test: graph probability by difference in means