User Community
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • Don’t miss your chance to experience Discovery Summit Europe at our best available rate! Early bird registration through 31 Oct.
  • Graph Builder Toolbar streamlines interactive graphing. Creates shortcuts on Report and GraphBuilder Helpers toolbars. Download and install the extension.
  • JMP will suspend normal business operations for our Rest and Recharge Day on Friday, October 2, 2026.
    Regular business hours will resume on Monday, October 5, 2026.

JMP Wish List

We want to hear your ideas for improving JMP. Share them here.
Choose Language Hide Translation Bar

Add superiority test to oneway analyses indicating the probability of being superior by different margins.

Status: New Submitted by Super User (Alumni) on ‎10-06-2021 10:34 AM
Comment

Add a test to produce p values of superiority tests at a range of distances and output those to a table or graph as shown below.

 

ih_1-1633695166276.png

Consider a trial where a process change is made.  Results are compared with current performance and a t test determines that the process was improved (the mean shifted) with a p-value of 0.05 and a superiority test in JMP 17 indicates that the mean shifted by at least 0.01 with a p value of 0.12, but neither tells a whole story.  To make an informed decision, we would want to know information like:

  • 5% chance the process stayed the same or got worse
  • 90% chance the process improved by at least 0.01
  • 50% chance the process improved by at least 0.006
  • 5% change the process improved by at least 0.011

Here is a post with two potential methods of calculating these values:

Compare means test: graph probability by difference in means