Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

Highlighted

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Apr 30, 2019 1:06 AM
(2871 views)

Hi All,

Question about Prediction Profiler.

I have a table with 2 columns (lets say distance and pass/fail) as attached in the images of this discussion.

When I perform nominal logistic fit moudule (Y=pass/fail, X=distance), and output a random table out of the profiler. I see that for some values the failure probability is 0 and for other similar values the probability is 1E-16 (see 2'nd image attached to this discussion).

A) why is that happening?

B) How can make that for all values of distance the probability will be a number other than 0 (1E-16 is fine for this example)

Thank you very much.

1 ACCEPTED SOLUTION

Accepted Solutions

Highlighted

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

This may be a rather extreme case for a data set as there is a perfect fit of the data for X=100, X=150, and X=160.

You'll notice in the Parameter Estimates output that the values are 'Unstable' (it doesn't really stand out in this platform.) If you look at your Prediction Profiler, you can see that it's predicting either 0 or 1 basically for your probabilities.

When I've had logistic regression situations where at a given value of X, I have perfect fits (all pass or all fail data), I use the GLM personality in Fit Model with the Binomial Distribution and Logit link function to fit a logistic regression. This output is much more obvious about the issues with the perfect fit data, and will suggest fitting with the Firth Bias-Adjusted Estimates option checked.

2 REPLIES 2

Highlighted

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

This may be a rather extreme case for a data set as there is a perfect fit of the data for X=100, X=150, and X=160.

You'll notice in the Parameter Estimates output that the values are 'Unstable' (it doesn't really stand out in this platform.) If you look at your Prediction Profiler, you can see that it's predicting either 0 or 1 basically for your probabilities.

When I've had logistic regression situations where at a given value of X, I have perfect fits (all pass or all fail data), I use the GLM personality in Fit Model with the Binomial Distribution and Logit link function to fit a logistic regression. This output is much more obvious about the issues with the perfect fit data, and will suggest fitting with the Firth Bias-Adjusted Estimates option checked.

Highlighted
##

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: Prediction Profiler - output random table

Thank you for the interesting inputs

Article Labels

There are no labels assigned to this post.