cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Browse apps to extend the software in the new JMP Marketplace
Choose Language Hide Translation Bar
VarunK
Level III

Regression model does not provide correct quadratic equation

Hello:

I created a 2^3 full factorial experiment with 4 center points. X1, X2 and X3  are the factors and Y is the response. X2 and X3 are just any random factor, but X1 is the radius and Y is the area. So mathematically relation is Y=3.14*X1^2

Below are the three scenarios where I computed regression equation based on just X1, both X1 and X1^2 and only X1^2.

 

When I only consider X1^2, it is no more significant. On further researching I came across Effect Heredity which states that we should have lower order effect included when we have higher order effect in our regression model. But than we will never be ale to find a relation that is pure quadratic as in this case.

 

I have also mentioned the model details that I used to analyze the data. Does different setting give me a better answer.

 

Please let me know if I have a serious flaw in my understanding and am doing a very basic mistake in understanding DOE.

 

VarunK_0-1693572401992.png

VarunK_1-1693572513849.png

 

VarunK_2-1693572524974.pngVarunK_3-1693572544270.png

VarunK_4-1693572559003.png

Your help is highly appreciated.

 

Best Regards,

Varun Katiyar

 

1 ACCEPTED SOLUTION

Accepted Solutions

Re: Regression model does not provide correct quadratic equation

Actually, the regression coefficients are correct. You are not able to see it because of the default factor coding that JMP uses when analyzing a designed experiment.

 

You see this prediction expression:

Dan_Obermiller_0-1693590711368.png

 

Notice that we should not expect the slope parameter to be 3.14 because that is not what is multiplying X^2. Instead, the 706.5 is multiplying ((x1-25)/15)*((x1-25)/15)).

If you save that prediction formula from the red triangle and open up that formula from the data table, you will see this:

Dan_Obermiller_1-1693590959581.png

Now from the red triangle at the top (highlighted here), choose Simplify:

Dan_Obermiller_4-1693592226429.png

You will see the modified equation with the 3.14 that you expected.

Dan_Obermiller_5-1693592283729.png

The 3925-157*X1 appears because the model that I simplified only had the quadratic term in it. That leads to these "extra terms" that should not be part of what we know as the true model. 

 

Now if we had fit the model following hierarchy (as recommended) and simplified this equation:

Dan_Obermiller_0-1693592888094.png

we will get exactly what you want (subject to round-off error)!

Dan_Obermiller_1-1693592944241.png

 

 

 

 

Dan Obermiller

View solution in original post

4 REPLIES 4
Victor_G
Super User

Re: Regression model does not provide correct quadratic equation

Hi @VarunK,

 

Learning about DoE by yourself can be very difficult, and you'll very likely encounter a lot of questions or difficulties. I would highly encourage you to learn DoE and statistics with some basic hands-on free courses :

Without some basic knowledge in stats and DoE, it will be very difficult to learn and understand how to use, define and apply DoE. It will also help you understand the factors coding seen in the prediction expressions.

 

It might also be better to practice on already defined use cases, as the one you create is not very representative on how a DoE would be used, it's more a mathematical/physical model than a research based on DoE, and may lack some attributes from DoE (effect heredity for example, no noise in the response, ...).

Or you can also practice by using the Simulate Response option in Custom design and specify a more complex model, with various degree of noise, and compare the model results with the theoritical simulated coefficients.


Also your design doesn't have "centre points" as you mention, it's only middle points for X1 (other factors X2 and X3 only have 2 levels) to estimate quadratic effects. 

Victor GUILLER
L'Oréal Data & Analytics

"It is not unusual for a well-designed experiment to analyze itself" (Box, Hunter and Hunter)
VarunK
Level III

Re: Regression model does not provide correct quadratic equation

Hello Victor:

 

I already completed the Design of Experiment Kit and will try to complete the STIPS course. Having said that, I also recently completed the DOE specialization from Arizona State University through Coursera. 

These all are the questions which were not directly answered and where I had some confusion on how DOE would answer them.

 

In the previous example that I have shared, the linear factor by itself gave me R^2 adj of 0.967, and including the quadratic term bumped it up to 1. If this relation was not know why should someone include the quadratic term?

 

I understand that DOE is mainly used to identify the factors and interactions that are significant and other sophisticated modeling technique might be required to gain a better relationship between the response and factor especially if quadratic effects are present.

 

Best Regards,

Varun Katiyar

Re: Regression model does not provide correct quadratic equation

Actually, the regression coefficients are correct. You are not able to see it because of the default factor coding that JMP uses when analyzing a designed experiment.

 

You see this prediction expression:

Dan_Obermiller_0-1693590711368.png

 

Notice that we should not expect the slope parameter to be 3.14 because that is not what is multiplying X^2. Instead, the 706.5 is multiplying ((x1-25)/15)*((x1-25)/15)).

If you save that prediction formula from the red triangle and open up that formula from the data table, you will see this:

Dan_Obermiller_1-1693590959581.png

Now from the red triangle at the top (highlighted here), choose Simplify:

Dan_Obermiller_4-1693592226429.png

You will see the modified equation with the 3.14 that you expected.

Dan_Obermiller_5-1693592283729.png

The 3925-157*X1 appears because the model that I simplified only had the quadratic term in it. That leads to these "extra terms" that should not be part of what we know as the true model. 

 

Now if we had fit the model following hierarchy (as recommended) and simplified this equation:

Dan_Obermiller_0-1693592888094.png

we will get exactly what you want (subject to round-off error)!

Dan_Obermiller_1-1693592944241.png

 

 

 

 

Dan Obermiller
VarunK
Level III

Re: Regression model does not provide correct quadratic equation

Thank you, Dan:

 

That was a great explanation.

 

Best Regards,

Varun Katiyar