cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
JMP is taking Discovery online, April 16 and 18. Register today and join us for interactive sessions featuring popular presentation topics, networking, and discussions with the experts.
Choose Language Hide Translation Bar
billi
Level V

Cook's D influence

In my regression analysis I saw couple of outliers and I ran my model by excluding the outliers to see if my results change and it did. However, when I looked at Cook's D influence values fro those data points they were all less than 1. Does that mean that those data points are not outliers and have no effect on the model?

Thanks

2 ACCEPTED SOLUTIONS

Accepted Solutions

Re: Cook's D influence

What was the basis for your initial conclusion that you 'saw a couple of outliers?'

 

How much did the results of your regression analysis change? In what way did they change?

 

Also, how many observations do you have? How many predictors did you use in the model? Are any of them collinear with others? Does your model include terms as transforms like square (X^2) or crossed (X1*X2)?

 

Cook's D is based on the sum of the differences for every observation between the predicted response using the full data set and the predicted response using the leave one out set. So one or two highly influential observations might not result in a large Cook's D if there are many observations.

View solution in original post

Re: Cook's D influence

A general rule of thumb for cutoff on Cook's D is to use 4/n. If your data had 40 data points, for example, a Cook's D > 0.1 would be considered influential. Using 1 may not be the best choice.

 

And to echo one of Mark Bailey's comments: an outlier is not always influential.

Untitled.jpg

Dan Obermiller

View solution in original post

4 REPLIES 4

Re: Cook's D influence

What was the basis for your initial conclusion that you 'saw a couple of outliers?'

 

How much did the results of your regression analysis change? In what way did they change?

 

Also, how many observations do you have? How many predictors did you use in the model? Are any of them collinear with others? Does your model include terms as transforms like square (X^2) or crossed (X1*X2)?

 

Cook's D is based on the sum of the differences for every observation between the predicted response using the full data set and the predicted response using the leave one out set. So one or two highly influential observations might not result in a large Cook's D if there are many observations.

Re: Cook's D influence

Cook's Distance is a measure of a data point's influence.  It doesn't flag outliers, just data points that contribute strongly to the model.  I've used Cook's D as part of investigations before I remove outliers, but I wouldn't call it justification unto itself for excluding an inconvenient data point.  

 

This article is a pretty good summary: Cook's Distance

 

M

Re: Cook's D influence

A general rule of thumb for cutoff on Cook's D is to use 4/n. If your data had 40 data points, for example, a Cook's D > 0.1 would be considered influential. Using 1 may not be the best choice.

 

And to echo one of Mark Bailey's comments: an outlier is not always influential.

Untitled.jpg

Dan Obermiller
billi
Level V

Re: Cook's D influence

Thank you all for response. An outlier is not always influential is what I wanted to know. Thank you Dan for the viz.this helps.