cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
The Discovery Summit 2025 Call for Content is open! Submit an abstract today to present at our premier analytics conference.
Get the free JMP Student Edition for qualified students and instructors at degree granting institutions.
Choose Language Hide Translation Bar
View Original Published Thread

Evaluating a Design Matrix for aliasing(confounding) in R and JMP have different answers

denalitastic
Level I
Screenshot 2025-02-05 at 12.29.06 AM.pngScreenshot 2025-02-05 at 12.37.05 AM.pngI have a design matrix , columns are factors with 2 levels, rows are experiments, see pics. I want to evaluate the design for aliasing (also called confounding). I obviously want a design that is free of confounding.  I thought as part of doing this i would take XT * X of my design to get the dot products across each column. If there is no confounding id expect 0 in every off diagonal term. When you do this lets say in R very clearly there are off diagonal terms out of a possible |22| some off diagonal terms are at most around |6|, see pics. However when I evalute this design in JMP and look at the alias matrix the off diagonal factor terms are zero i( i messed around with the alias model terms to evaluate the main effects only). This seems like some simple linear algebra but perhaps I am having some fundamental misunderstanding. If the dot products of the column vectors are not zero then they are not orthogonal. Maybe this is an incorrect way to think about this but 6 out of possible 22 seems like a pretty substantial amount of confounding.  What is JMP doing that I am missing, or where is my understanding wrong, surely i am wrong. 
6 REPLIES 6


Re: Evaluating a Design Matrix for aliasing(confounding) in R and JMP have different answers

Hi,

 

It is hard to tell what you did outside of JMP without seeing any report/calculations.

 

Designs with no confounding between the main effects might show an alias matrix like you are getting. This should be the usual expected behaviour for screening design types. 

 

When I build a custom design in JMP only including the main effects the color map of correlations looks like this:

Jonas_Rinne_0-1738744921141.png

 

You can see that there is no correlation/cofounding between the main effects (yellow area), but a lot of correlation between higher order terms.

 

The alias matrix has a different purpose which Ryan explained down below. 

 

Usually you want check the color map of correlations in your report for correlation/confounding properties of the design.

 

edit: fixed a misleading statement about the alias matrix

denalitastic
Level I


Re: Evaluating a Design Matrix for aliasing(confounding) in R and JMP have different answers

denalitastic_0-1738963272420.png

denalitastic_1-1738963323122.png

Here is what the color correlations look like. I used only the main effects in alias terms. The alias matrix is a 1s and 0s, but the color correlation map has some off diagonal terms that are not 0.  next reply i will show what i did outside JMP.

 

denalitastic
Level I


Re: Evaluating a Design Matrix for aliasing(confounding) in R and JMP have different answers

denalitastic_2-1738963560011.png

Dot products of 16 columns of the design matrix (i.e. the 16 factors over 22 experiments) leads to a 16 by 16 matrix.

denalitastic_3-1738963626697.png


again it looks like there are off diagonal terms.  And based on the scale of 22 for -6 looks like a decently large relationship in an absolute value sense. Perhaps i have some very fundamental misunderstanding. Another possibility is there is some cutoff at which off diagonal terms are ignored. But then i would suggest a confounding that is on the order of 

denalitastic
Level I


Re: Evaluating a Design Matrix for aliasing(confounding) in R and JMP have different answers

Another small thing for some reason if you put the main effects in the alias terms you see the factors repeated in the color map correlations. If you remove them and leave alias terms empty you dont see an alias matrix, but the color map correlations now only show one copy. Bug?

denalitastic
Level I


Re: Evaluating a Design Matrix for aliasing(confounding) in R and JMP have different answers

denalitastic_4-1738965015717.png

heres another image , iused main effects in model terms, and added both main efects and 2nd order interactions in the alias terms. You can see in the color map correlations the dark block of 2nd order vs 2nd order. but main effects vs main effects and main effects vs 2nd order are about the same light grey color . Why then does the alias matrix list 0s for the main effects vs main effect off diagonals but various numbers for the main effect vs 2nd orders.  Again im sure its just something im not understanding. 


Re: Evaluating a Design Matrix for aliasing(confounding) in R and JMP have different answers

The Alias Matrix reflects what happens to terms in your model when you do not include them. The rendering is not quite right, but you'll see if your "Z" (i.e. the columns reflecting the alias terms) are the same as your model terms, you'll get the identity matrix you're seeing.

https://community.jmp.com/t5/R-D-Blog/What-is-an-Alias-Matrix/ba-p/30448

 

Those correlation between your model terms (you don't need them in the alias terms to see this) will increate the standard error of your parameter estimates when you fit the model. The Estimation Efficiency outline helps you see just how much larger it would be compared to if you could make all those effects perfectly orthogonal:

https://www.jmp.com/support/help/en/18.1/index.shtml#page/jmp/estimation-efficiency.shtml

 

I like to use the Color Map as a quick look into the properties of the design, whereas the Estimation Efficiency/Alias Matrix when I'm considering which terms are in the model vs. not.