cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Choose Language Hide Translation Bar

Add superiority test to oneway analyses indicating the probability of being superior by different margins.

Status: New Submitted by Super User (Alumni) on ‎10-06-2021 10:34 AM
Comment

Add a test to produce p values of superiority tests at a range of distances and output those to a table or graph as shown below.

 

ih_1-1633695166276.png

Consider a trial where a process change is made.  Results are compared with current performance and a t test determines that the process was improved (the mean shifted) with a p-value of 0.05 and a superiority test in JMP 17 indicates that the mean shifted by at least 0.01 with a p value of 0.12, but neither tells a whole story.  To make an informed decision, we would want to know information like:

  • 5% chance the process stayed the same or got worse
  • 90% chance the process improved by at least 0.01
  • 50% chance the process improved by at least 0.006
  • 5% change the process improved by at least 0.011

Here is a post with two potential methods of calculating these values:

Compare means test: graph probability by difference in means