This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Submit your abstract to the call for content for Discovery Summit Americas by April 23. Selected abstracts will be presented at Discovery Summit, Oct. 21- 24.
Discovery is online this week, April 16 and 18. Join us for these exciting interactive sessions.
Choose Language Hide Translation Bar
ryandgus
ryandgus
Level I

Determine significance of difference between percent differences

Jul 19, 2018 02:18 PM (5824 views)

I have four sets of data from two experiments: one set of "before" measurements and one set of "after" measurements for each experiment. For each experiment, I have calculated a percent difference between the mean of "before" data and the mean of "after" data. I would like to know if the difference between the percent difference calculated for Experiment 1 and the percent difference calculated for Experiment 2 is significant. Can this be done in JMP? If so, can anyone indicate how this might be done?

 

For context/example, let's say that the percent difference between the means of before and after data in Experiment 1 is 30% and the percent difference between the means of before and after data in Experiment 2 is 33%. My sense is that 33% difference is not significantly different from 30% difference, but is this even a valid statistical question? I have tried searching Google for an answer to this and have come up short, but a colleague recommended JMP for this type of analysis.

0 Kudos
2 REPLIES 2
Mark_Bailey
Staff Mark_Bailey
Staff

Re: Determine significance of difference between percent differences

Jul 19, 2018 03:51 PM (5810 views)  |  Posted in reply to message from ryandgus 07-19-2018

You are using some terminology in an ambiguous way but that's OK. Without seeing your design or your data, I can only give a few thoughts.

 

Generally, it is better to work with the raw data instead of the reduced data. For example, analyze the measurements, not the percent change. For example, analyze the measurements, not their means.

 

The analysis of such data usually involves a linear model. If you have one factor, you can use Analyze > Fit Y by X. If you have more than one factor, then use Analyze > Fit Model.

 

See Help > Books > Design of Experiments for examples of experiments and analysis. Also, see Help > Books > Basic Analysis or Fitting Linear Models for more details on the regression analysis.

gzmorgan0
Super User (Alumni) gzmorgan0
Super User (Alumni)

Re: Determine significance of difference between percent differences

Jul 20, 2018 03:23 AM (5784 views)  |  Posted in reply to message from Mark_Bailey 07-19-2018

Mark Bailey is absolutely correct, you should work with the observations' data and not just an aggregated summary statistic.

 

The attached file is a journal file with notes of paired analyses using the JMP Sample Data table Dogs.jmp. Since I did this in JMP 14, I am also attaching a .pdf file, in case you have an older version of JMP and it will not open.

 

Read the notes. Hopefuly this will give you some ideas on which JMP graphs and analyses to use.

 

Good luck.

Preview file
329 KB
Dogs_Example.jrn