cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • JMP Security Notice: CVE-2026-109618 and CVE-2026-109619

    JMP promptly initiated a review of its products, services, and relevant infrastructure for exposure to CVE-2026-109618 and CVE-2026-109619.

    Our assessment of JMP products has not identified exposure to these vulnerabilities. Where remediation was required within supporting environments, appropriate security updates and controls have been applied and validated.

    We have identified no evidence of successful exploitation or unauthorized access to JMP systems or customer information associated with these vulnerabilities.

    JMP continues to monitor the issue and relevant vendor guidance. No action is required by JMP customers at this time.

  • Don’t miss your chance to experience Discovery Summit Europe at our best available rate! Early bird registration through 31 Oct.
  • Graph Builder Toolbar streamlines interactive graphing. Creates shortcuts on Report and GraphBuilder Helpers toolbars. Download and install the extension.

Discussions

Solve problems, and share tips and tricks with other JMP users.
Choose Language Hide Translation Bar
dadawasozo
Level V

DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

Hi,

Can someone help me to understand the null/alternate hypothesis test in effect summary and parameter estimate table?

is there document explain it with equation?

 

Thanks

6 REPLIES 6

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

I may be running the risk of oversimplifying, but the null hypothesis is NULL because it takes the stance of "no effect" or "no difference". For parameter effects, that means the null hypothesis is "This factor has no effect" which means "The parameter estimate for this effect equals zero."

 

The alternative hypothesis is the opposite of the null. So, "this parameter estimate is different than zero."

Dan Obermiller
dadawasozo
Level V

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

Hi,

 

I'm getting confused.

1)it looks like both hypothesis test in Effect Summary and Parameter Estimate is testing "no effect".

 

my question:

1) what is the t-test equation for these 2 tests?

2) what these 2 type of hypothesis test against
    - Effect summary hypothesis (Pvalue)

    - Parameter estimate (Prob>|t|)

 

statman
Super User

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

In general, test of significance (p-values) are tests based on rejecting or not rejecting the Null Hypothesis.  The p-value is the associated probability of a Type 1 or alpha error (rejecting the Null when the Null is true). These tests can be done on different statistics with different associated probability distributions (e.g., t, F, Chi square, etc).  The Parameter Estimates reports the coefficients of the model and Prob>|t| is the probability a value greater than the calculated t Ratio (Estimate/Std Error) could exist by chance alone (this is actually area of the probability distribution, in this case Student's t-distribution beyond the calculated test statistic) .  Effects tests use the calculated F ratio (mean square effect/mean square error) in the same way.  The Prob>F is the probability a value greater than the calculated F-Ratio could exist by chance alone (i.e., when the effect = 0). 

This picture might clarify graphically what is being calculated.

Screen Shot 2020-10-11 at 10.59.43 AM.jpg

 

"All models are wrong, some are useful" G.E.P. Box
dadawasozo
Level V

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

Hi,

 

 

I still don't get the "mean square effect/mean square error" related to the P value in effect summary.

Please refer to the attachment. This is the Pvalue in Effect summary table. Can you help me to understand how individual effect's pvalue is calculated?

 

statman
Super User

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

Re: DOE: What is the null hypothesis test in effect summary table (pvalue) and parameter estimate (prob>|t|)

The Analysis of Variance table tests the 'whole model.' That is, the null hypothesis is that all the parameters (except the constant term) are zero versus the alternative hypothesis that not all the parameters are zero. The test is based on the ratio of variances (MS Model / MS Error). This F ratio is used to obtain the p-value that is reported in the Analysis of Variance table and also below horizontal axis of the Actual by Predicted plot.

 

The Effect Summary reports tests for individual parameter estimates. It compares the parameter estimate to the hypothesized parameter (zero) by difference and then makes a t ratio by dividing by the standard error of the estimate. The t ratio is, therefore, the number of standard errors that the estimate is from the hypothesized value. The t ratio is used to obtain the p-value in the Effects Summary table.

 

Note that while both of these tests are asking a question about the parameter estimates, they are not asking the same question. They are also not using the same method to obtain an answer. So they will not necessarily agree or provide consistent answers. For example, the whole model F test might indicate that you should not reject the null hypothesis while one or more of the t tests might indicate that you should reject the null. Remember that they are not the same hull hypothesis.

Recommended Articles