Share your ideas for the JMP Scripting Unsession at Discovery Summit by September 17th. We hope to see you there!
Choose Language Hide Translation Bar
Highlighted
illimani
Level II

Check for multicollinearity in Ordinal logistic regression

Hello everyone! I’m running a nominal logistic Reg Model (JMP v13) which has 8 independent variables. I am concerned about collinearity and confounding. How can I check the existence of these two issues? Can you evaluate multi-collinearity with Variation inflation factor in JMP? (kindly, how?) Thanks.

2 ACCEPTED SOLUTIONS

Accepted Solutions
Highlighted
txnelson
Super User

Re: Check for multicollinearity in Ordinal logistic regression

Under Help==>Statistics Index==>multicollinearity points to the Variation Inflation Factors in the Fit Model Platform, for the determination of the existence of multicollinearity.

"In regression where the regressors are highly correlated, a measure of interest is how much inflated the variance of the estimator compared with what its variance would be without the effect of the other regressors. In Fit Model the VIF is available by context-clicking in the Prameter Estimates report table."

Jim

View solution in original post

Highlighted

Re: Check for multicollinearity in Ordinal logistic regression

A couple suggestions for you:

 

1. Take full advantage of version 13's improved experimental design diagnostic capabilities by taking your matrix of predictor variables and 'pretend' if indeed it wasn't, a designed experiment, and use the DOE -> Design Diagnostics -> Evaluate Designs platform. Within that platform's report you'll get all sorts of diagnostics including confounding and correlations for your predictor variables based on the predictor variable matrix. The platform doesn't require that your predictor variable matrix is indeed a 'designed experiment'. One key feature of this platform from a confounding perspective is you can specify the exact model form (main effects, 2 way interactions, etc.) you'd like to estimate.

 

2. Use the Multivariate platform to explore correlations (pairwise and more complex using, say principle components analysis) among the matrix of predictor variables.

View solution in original post

6 REPLIES 6
Highlighted
txnelson
Super User

Re: Check for multicollinearity in Ordinal logistic regression

Under Help==>Statistics Index==>multicollinearity points to the Variation Inflation Factors in the Fit Model Platform, for the determination of the existence of multicollinearity.

"In regression where the regressors are highly correlated, a measure of interest is how much inflated the variance of the estimator compared with what its variance would be without the effect of the other regressors. In Fit Model the VIF is available by context-clicking in the Prameter Estimates report table."

Jim

View solution in original post

Highlighted
illimani
Level II

Re: Check for multicollinearity in Ordinal logistic regression

Thanks Jim. Can JMP provide VIF's for categorical independent variables?
--Erick
Highlighted

Re: Check for multicollinearity in Ordinal logistic regression

A couple suggestions for you:

 

1. Take full advantage of version 13's improved experimental design diagnostic capabilities by taking your matrix of predictor variables and 'pretend' if indeed it wasn't, a designed experiment, and use the DOE -> Design Diagnostics -> Evaluate Designs platform. Within that platform's report you'll get all sorts of diagnostics including confounding and correlations for your predictor variables based on the predictor variable matrix. The platform doesn't require that your predictor variable matrix is indeed a 'designed experiment'. One key feature of this platform from a confounding perspective is you can specify the exact model form (main effects, 2 way interactions, etc.) you'd like to estimate.

 

2. Use the Multivariate platform to explore correlations (pairwise and more complex using, say principle components analysis) among the matrix of predictor variables.

View solution in original post

Highlighted

Re: Check for multicollinearity in Ordinal logistic regression

I assume that you are using the Analyze > Fit Model launch with the Nominal Logistic personality. My example from the Big Class sample data table fits sex = intercept + weight + height + weight * height. The result is:

Nominal Logistic Regression.jpeg

Tthe Covariance of Estimates is available. The diagonal is the variance of the estimates and the off-diagonal are the covariances, which would be zero if there were no collinearity.

Notice that the predictors are automatically centered to minimize the correlation of the estimates.

Learn it once, use it forever!
Highlighted
illimani
Level II

Re: Check for multicollinearity in Ordinal logistic regression

Mark,

Thanks. All the independent variables used in your example are continuous. Can we expect this result to hold true when the model uses also (or only) categorical variables? Kindly tell me a bit more of your explanation "Notice that the predictors are automatically centered to minimize the correlation of the estimates". Which predictors? and 'centered' in relation to what?

--Erick

Highlighted
ghartel
Level III

Re: Check for multicollinearity in Ordinal logistic regression

I know this post is a few years old not, but I just encountered the same issue where a journal reviewer insisted on seeing VIF to check on collinearity in a logistic regression.  None of the Generalized regression platforms (other than Normal) give VIFs, but as the VIF is completely a function of the X matrix, it doesn't matter what kind of Y variable you have.  So my solution was to run exactly the same model using Fit Model with the Standard Least Squares personality, and used the VIF values from the Parameter estimates table.  

Article Labels

    There are no labels assigned to this post.