topic Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|) in Discussions

DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

dadawasozo — Sat, 10 Jun 2023 23:20:11 GMT

Hi,

Can someone help me to understand the null/alternate hypothesis test in effect summary and parameter estimate table?

is there document explain it with equation?

Thanks

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

Dan_Obermiller — Sun, 11 Oct 2020 15:47:32 GMT

I may be running the risk of oversimplifying, but the null hypothesis is NULL because it takes the stance of "no effect" or "no difference". For parameter effects, that means the null hypothesis is "This factor has no effect" which means "The parameter estimate for this effect equals zero."

The alternative hypothesis is the opposite of the null. So, "this parameter estimate is different than zero."

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

dadawasozo — Sun, 11 Oct 2020 15:56:31 GMT

Hi,

I'm getting confused.

1)it looks like both hypothesis test in Effect Summary and Parameter Estimate is testing "no effect".

my question:

1) what is the t-test equation for these 2 tests?

2) what these 2 type of hypothesis test against
- Effect summary hypothesis (Pvalue)

- Parameter estimate (Prob>|t|)

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

statman — Sun, 11 Oct 2020 17:08:33 GMT

In general, test of significance (p-values) are tests based on rejecting or not rejecting the Null Hypothesis. The p-value is the associated probability of a Type 1 or alpha error (rejecting the Null when the Null is true). These tests can be done on different statistics with different associated probability distributions (e.g., t, F, Chi square, etc). The Parameter Estimates reports the coefficients of the model and Prob>|t| is the probability a value greater than the calculated t Ratio (Estimate/Std Error) could exist by chance alone (this is actually area of the probability distribution, in this case Student's t-distribution beyond the calculated test statistic) . Effects tests use the calculated F ratio (mean square effect/mean square error) in the same way. The Prob>F is the probability a value greater than the calculated F-Ratio could exist by chance alone (i.e., when the effect = 0).

This picture might clarify graphically what is being calculated.

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

dadawasozo — Sun, 11 Oct 2020 18:04:23 GMT

Hi,

I still don't get the "mean square effect/mean square error" related to the P value in effect summary.

Please refer to the attachment. This is the Pvalue in Effect summary table. Can you help me to understand how individual effect's pvalue is calculated?

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

statman — Sun, 11 Oct 2020 18:09:00 GMT

https://www.jmp.com/support/help/en/15.2/?os=mac&source=application&utm_source=helpmenu&utm_medium=application#page/jmp/interactive-effect-summary.shtml

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

Mark_Bailey — Mon, 12 Oct 2020 17:28:11 GMT

The Analysis of Variance table tests the 'whole model.' That is, the null hypothesis is that all the parameters (except the constant term) are zero versus the alternative hypothesis that not all the parameters are zero. The test is based on the ratio of variances (MS Model / MS Error). This F ratio is used to obtain the p-value that is reported in the Analysis of Variance table and also below horizontal axis of the Actual by Predicted plot.

The Effect Summary reports tests for individual parameter estimates. It compares the parameter estimate to the hypothesized parameter (zero) by difference and then makes a t ratio by dividing by the standard error of the estimate. The t ratio is, therefore, the number of standard errors that the estimate is from the hypothesized value. The t ratio is used to obtain the p-value in the Effects Summary table.

Note that while both of these tests are asking a question about the parameter estimates, they are not asking the same question. They are also not using the same method to obtain an answer. So they will not necessarily agree or provide consistent answers. For example, the whole model F test might indicate that you should not reject the null hypothesis while one or more of the t tests might indicate that you should reject the null. Remember that they are not the same hull hypothesis.