cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Choose Language Hide Translation Bar

What is the intuitive explanation for wider confidence interval band in regression?

Hello,

We can easily find that the confidence interval for the regression gets wider than the center from the following equation: Screenshot 2023-05-08 at 11.22.33 AM.png But why is that?  Is there an intuitive explanation for that? Thank you!

2 ACCEPTED SOLUTIONS

Accepted Solutions
statman
Super User

Re: What is the intuitive explanation for wider confidence interval band in regression?

I see the need to modify my post.  First, context matters.  How was the data collected?  This can have an effect on interpretation. I am trying to provide an intuitive explanation, not a technically correct explanation. If you notice the squared term in the equation.  The farther away from the mean the greater the uncertainty (by uncertainty, I mean the dictionary definition not MSE), hence the wider the confidence intervals. Given there is uncertainty in the estimate of the mean (or Y intercept) and in the estimate of the slope of the regression line, as you get farther from the mean, the uncertainty in the estimation of the slope increases.

Intuitively think of these situations:

Imagine what happens to your confidence in predicting the weather in 1 hour vs. 24 hours vs. next week or

confidence in predicting traffic in the next block vs. 1 mile away vs. 100 miles away.

"All models are wrong, some are useful" G.E.P. Box

View solution in original post

Re: What is the intuitive explanation for wider confidence interval band in regression?

A clarification: the uncertainty in the slope is constant. It is represented in two ways. The standard error of the estimate of the slope parameter indicates the expected variation in the estimate across all possible random samples of data of the same size from the same populations. The standard error can also indicate the uncertainty as a confidence interval of the slope estimate. Both representations are constant or independent of X.

The expression above is about the uncertainty in the estimated mean response assuming the model is correct and the variance of the response is independent of X. Notice MSE in the expression? It is a constant. It does not depend on X. If it did, then linear regression would be inappropriate and regression results would be misleading.

View solution in original post

5 REPLIES 5
statman
Super User

Re: What is the intuitive explanation for wider confidence interval band in regression?

I see the need to modify my post.  First, context matters.  How was the data collected?  This can have an effect on interpretation. I am trying to provide an intuitive explanation, not a technically correct explanation. If you notice the squared term in the equation.  The farther away from the mean the greater the uncertainty (by uncertainty, I mean the dictionary definition not MSE), hence the wider the confidence intervals. Given there is uncertainty in the estimate of the mean (or Y intercept) and in the estimate of the slope of the regression line, as you get farther from the mean, the uncertainty in the estimation of the slope increases.

Intuitively think of these situations:

Imagine what happens to your confidence in predicting the weather in 1 hour vs. 24 hours vs. next week or

confidence in predicting traffic in the next block vs. 1 mile away vs. 100 miles away.

"All models are wrong, some are useful" G.E.P. Box

Re: What is the intuitive explanation for wider confidence interval band in regression?

A clarification: the uncertainty in the slope is constant. It is represented in two ways. The standard error of the estimate of the slope parameter indicates the expected variation in the estimate across all possible random samples of data of the same size from the same populations. The standard error can also indicate the uncertainty as a confidence interval of the slope estimate. Both representations are constant or independent of X.

The expression above is about the uncertainty in the estimated mean response assuming the model is correct and the variance of the response is independent of X. Notice MSE in the expression? It is a constant. It does not depend on X. If it did, then linear regression would be inappropriate and regression results would be misleading.

statman
Super User

Re: What is the intuitive explanation for wider confidence interval band in regression?

Point taken, the OP wants an intuitive explanation and I assume this means not the text book explanation.  Perhaps I have failed in my attempt.

"All models are wrong, some are useful" G.E.P. Box

Re: What is the intuitive explanation for wider confidence interval band in regression?

You didn't fail! I just wanted to use clear and consistent terminology when someone is learning a concept for the first time. So many forks in the road...

StefanC
Level III

Re: What is the intuitive explanation for wider confidence interval band in regression?

As you sample more data and update your regression line, you will find that the vertical distance between the old and new regression line is largest at the ends and smallest at the centre. Thus it makes sense that the confidence band is wider at the ends.