Subscribe Bookmark RSS Feed

Practical Explanation of Parameter Estimates

iPSC

New Contributor

Joined:

Jun 28, 2017

I am working with the Fit Model Platform with a continous output variable and multiple nominal input variables.

 

I understand that the within the Parameter Estimates table the T value is there to test wheteher or not the estimate is equal to zero.  In a practical sense, if I have a variable (Cell Lot) with 3 categories (1, 2 and 3) and the two listed (1 & 2) in the Parameter Estimates Table are less than the alpha of 0.05, what is the conclusion that can be made?  Are 1 and 2 significantly different from 3?

 

I already know from the Effects tests that this variable (Cell Lot) is a significant contributer to the output.

 

Please forgive the naive question.

2 ACCEPTED SOLUTIONS

Accepted Solutions
markbailey

Staff

Joined:

Jun 23, 2011

Solution

You are correct. The Effect Test is based on the type III sum of squares associated with adding a term to the model. It is the F test. You have one F test for each term. This test is useful for model reduction and inference about factor effects.

On the other hand, the Parameter Estimates reports the t test because it compares the estimate to the value of the null hypothesis, which is that the parameter is zero. (You can test against other null hypotheses with a t test but JMP does not provide such a test. There is a script for this purpose.) You have one t test for each estimate.

If you want to see the results for the last level, click the red triangle at the top next to Fit Least Squares and select Estimates > Expanded Estimates. (JMP does not report the last level by default because the estimate of the last parameter must be equal to the negative of the sum of the other parameter estimates. You can enable Expanded Estimates in the platform preferences if you like.)

The interpretation of these tests is limited to an independent test versus 0. Your example concludes that the estimates for level 1 and level 2 are different from zero. That is all that you can say. These tests do not compare these levels to the last level. You could use an additional contrast for this purpose.

You also have to be concerned about the multiple comparisons issue of inflated type I error rate with all these tests.

Learn it once, use it forever!
markbailey

Staff

Joined:

Jun 23, 2011

Solution

Yes, Tukey's method of multiple comparisons would be the best way to all of the lots to each other. Do not use the Student t method as it does not adjust for the number of comparisons, so your type I error rate over all the comparisons will increase much.

Yes, you can use the p-values as usual with the appropriate adjustment.

Learn it once, use it forever!
4 REPLIES
markbailey

Staff

Joined:

Jun 23, 2011

Solution

You are correct. The Effect Test is based on the type III sum of squares associated with adding a term to the model. It is the F test. You have one F test for each term. This test is useful for model reduction and inference about factor effects.

On the other hand, the Parameter Estimates reports the t test because it compares the estimate to the value of the null hypothesis, which is that the parameter is zero. (You can test against other null hypotheses with a t test but JMP does not provide such a test. There is a script for this purpose.) You have one t test for each estimate.

If you want to see the results for the last level, click the red triangle at the top next to Fit Least Squares and select Estimates > Expanded Estimates. (JMP does not report the last level by default because the estimate of the last parameter must be equal to the negative of the sum of the other parameter estimates. You can enable Expanded Estimates in the platform preferences if you like.)

The interpretation of these tests is limited to an independent test versus 0. Your example concludes that the estimates for level 1 and level 2 are different from zero. That is all that you can say. These tests do not compare these levels to the last level. You could use an additional contrast for this purpose.

You also have to be concerned about the multiple comparisons issue of inflated type I error rate with all these tests.

Learn it once, use it forever!
iPSC

New Contributor

Joined:

Jun 28, 2017

Thank you very much for you detailed answer Mark.  

 

As a follow up, if I did want to explore whether or not Cell lots #1,2, and 3 were significantly different from one another using this model.  Would choosing Multiple Comparisions and then Tukey or Student's T (depending on which is appreopriate) be the appropriate method?  When I do this I see an All Pairwise Differences Table with 3 comparisons between each possible two category combination (1&2, 1&3, 2&3).  In this case would p values less than alpha indicate a significant difference between those two groups?

 

 

markbailey

Staff

Joined:

Jun 23, 2011

Solution

Yes, Tukey's method of multiple comparisons would be the best way to all of the lots to each other. Do not use the Student t method as it does not adjust for the number of comparisons, so your type I error rate over all the comparisons will increase much.

Yes, you can use the p-values as usual with the appropriate adjustment.

Learn it once, use it forever!
iPSC

New Contributor

Joined:

Jun 28, 2017

Thank you very much!