topic Re: Cook's D influence in Discussions

Cook's D influence

billi — Tue, 16 Apr 2019 18:39:03 GMT

In my regression analysis I saw couple of outliers and I ran my model by excluding the outliers to see if my results change and it did. However, when I looked at Cook's D influence values fro those data points they were all less than 1. Does that mean that those data points are not outliers and have no effect on the model?

Thanks

Re: Cook's D influence

Mark_Bailey — Tue, 16 Apr 2019 19:55:43 GMT

What was the basis for your initial conclusion that you 'saw a couple of outliers?'

How much did the results of your regression analysis change? In what way did they change?

Also, how many observations do you have? How many predictors did you use in the model? Are any of them collinear with others? Does your model include terms as transforms like square (X^2) or crossed (X1*X2)?

Cook's D is based on the sum of the differences for every observation between the predicted response using the full data set and the predicted response using the leave one out set. So one or two highly influential observations might not result in a large Cook's D if there are many observations.

Re: Cook's D influence

MikeD_Anderson — Tue, 16 Apr 2019 19:59:07 GMT

Cook's Distance is a measure of a data point's influence. It doesn't flag outliers, just data points that contribute strongly to the model. I've used Cook's D as part of investigations before I remove outliers, but I wouldn't call it justification unto itself for excluding an inconvenient data point.

This article is a pretty good summary: Cook's Distance

Re: Cook's D influence

Dan_Obermiller — Tue, 16 Apr 2019 20:31:32 GMT

A general rule of thumb for cutoff on Cook's D is to use 4/n. If your data had 40 data points, for example, a Cook's D > 0.1 would be considered influential. Using 1 may not be the best choice.

And to echo one of Mark Bailey's comments: an outlier is not always influential.

Re: Cook's D influence

billi — Wed, 17 Apr 2019 17:29:30 GMT

Thank you all for response. An outlier is not always influential is what I wanted to know. Thank you Dan for the viz.this helps.