Choose Language Hide Translation Bar

Improving Equivalence Tests in Fit Y by X

I've been a big fan of equivalence tests in JMP. For a one-sample scenario in the Distribution platform I like the output because it has a nice graphical representation of the equivalence bounds overlaid with the confidence intervals on the mean. You also get a deliberate interpretation statement at the bottom.

 

In a multi-sample scenario in the Fit Y by X platform it's less interpretable. I was in a meeting with a few engineers, and they had no idea how to interpret the two normal distributions and indicated they definitely prefer the one-sample case.

 

My proposal would be to create similar output in Fit Y by X as to what you see in the Distribution platform. For the example above, the equivalence bounds of [-6, +6] can be easily shown with a red confidence interval based on the actual output (centered around 3.02).

Tracking Number: 7612660630

Defect ID: S1362104

2 Comments
Community Manager
Status changed to: In Development

In JMP 16 we are improving the equivalence test in Fit Y by X as suggested here.

Level III

I have a somewhat related request. We often use a contingency plot to show proportional outcomes between groups. An example yield plot for 3 groups is shown below (yield is "good"=G or "bad"=B). It would be super useful to include confidence intervals on this plot so that users don't have a false sense of difference in groups from looking at this raw plot. Looking at this plot doesn't give a sense for whether the groups are different or not different, depending on the N per group.

bayesfactor_0-1587491571272.png