Turn on suggestions

Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

- JMP User Community
- :
- Discussions
- :
- Discussions
- :
- Check for multicollinearity in Ordinal logistic regression

Topic Options

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Nov 25, 2016 5:07 AM
(10685 views)

Hello everyone! I’m running a nominal logistic Reg Model (JMP v13) which has 8 independent variables. I am concerned about collinearity and confounding. How can I check the existence of these two issues? Can you evaluate multi-collinearity with Variation inflation factor in JMP? (kindly, how?) Thanks.

2 ACCEPTED SOLUTIONS

Accepted Solutions

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Under Help==>Statistics Index==>multicollinearity points to the Variation Inflation Factors in the Fit Model Platform, for the determination of the existence of multicollinearity.

"In regression where the regressors are highly correlated, a measure of interest is how much inflated the variance of the estimator compared with what its variance would be without the effect of the other regressors. In Fit Model the VIF is available by context-clicking in the Prameter Estimates report table."

Jim

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

A couple suggestions for you:

1. Take full advantage of version 13's improved experimental design diagnostic capabilities by taking your matrix of predictor variables and 'pretend' if indeed it wasn't, a designed experiment, and use the DOE -> Design Diagnostics -> Evaluate Designs platform. Within that platform's report you'll get all sorts of diagnostics including confounding and correlations for your predictor variables based on the predictor variable matrix. The platform doesn't require that your predictor variable matrix is indeed a 'designed experiment'. One key feature of this platform from a confounding perspective is you can specify the exact model form (main effects, 2 way interactions, etc.) you'd like to estimate.

2. Use the Multivariate platform to explore correlations (pairwise and more complex using, say principle components analysis) among the matrix of predictor variables.

5 REPLIES 5

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Under Help==>Statistics Index==>multicollinearity points to the Variation Inflation Factors in the Fit Model Platform, for the determination of the existence of multicollinearity.

"In regression where the regressors are highly correlated, a measure of interest is how much inflated the variance of the estimator compared with what its variance would be without the effect of the other regressors. In Fit Model the VIF is available by context-clicking in the Prameter Estimates report table."

Jim

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: Check for multicollinearity in Ordinal logistic regression

Thanks Jim. Can JMP provide VIF's for categorical independent variables?

--Erick

--Erick

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

A couple suggestions for you:

1. Take full advantage of version 13's improved experimental design diagnostic capabilities by taking your matrix of predictor variables and 'pretend' if indeed it wasn't, a designed experiment, and use the DOE -> Design Diagnostics -> Evaluate Designs platform. Within that platform's report you'll get all sorts of diagnostics including confounding and correlations for your predictor variables based on the predictor variable matrix. The platform doesn't require that your predictor variable matrix is indeed a 'designed experiment'. One key feature of this platform from a confounding perspective is you can specify the exact model form (main effects, 2 way interactions, etc.) you'd like to estimate.

2. Use the Multivariate platform to explore correlations (pairwise and more complex using, say principle components analysis) among the matrix of predictor variables.

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: Check for multicollinearity in Ordinal logistic regression

I assume that you are using the **Analyze** > **Fit Model** launch with the Nominal Logistic personality. My example from the Big Class sample data table fits sex = intercept + weight + height + weight * height. The result is:

Tthe Covariance of Estimates is available. The diagonal is the variance of the estimates and the off-diagonal are the covariances, which would be zero if there were no collinearity.

Notice that the predictors are automatically centered to minimize the correlation of the estimates.

Learn it once, use it forever!

- Mark as New
- Bookmark
- Subscribe
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: Check for multicollinearity in Ordinal logistic regression

Mark,

Thanks. All the independent variables used in your example are continuous. Can we expect this result to hold true when the model uses also (or only) categorical variables? Kindly tell me a bit more of your explanation "Notice that the predictors are automatically centered to minimize the correlation of the estimates". Which predictors? and 'centered' in relation to what?

--Erick