cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • Learn how to build custom Python data connectors and further customize JMP’s Data Connector Framework with the Python Data Connector Demo, available now in the JMP Marketplace!
  • See how to create experiments to support product design and ID useful product features. Register for June 12 webinar, 2pm US Eastern Time.

Discussions

Solve problems, and share tips and tricks with other JMP users.
Choose Language Hide Translation Bar
AnastasiaMan
Level I

Validation for Logistic regression model JMP 15

I saw many comments on how to run a validation for a jmp pro version, that unfortunately I don't have.

In jmp 15, when I open the Fit Model, there is no box to add the validation column.

 

So, what I did was to create manually a validation column, with 60% data for training, 20% for validation and 20% for testing.

I build the model based on the training dataset, and I can see the predictions for the validation and testing set.

 

How can I generate the R^2 and other fit details for the validation dataset on the model that is build on the training set? 

3 REPLIES 3
dale_lehman
Level VII

Re: Validation for Logistic regression model JMP 15

I am assuming you excluded the test data when fitting the model (I'm not sure what you did about the validation data - if you excluded that as well, then the test data is redundant - otherwise, I'm not sure what purpose the validation data served in your analysis).  Unexclude all the rows and use Fit Y by X, with Y as the predictions and X as the actual values - and put Validation in the By box.  You will get separate plots (and R-squared) for each subset.

AnastasiaMan
Level I

Re: Validation for Logistic regression model JMP 15

Hi and thank you, it does work.

But does it calculate 3 different models based on each subset?

What I initially did, was to use only the training set for building the model, and as I have more than one possible models, I want to fit them in the validation data to choose the best one. So, I need to apply the same model built on the training dataset, to the validation dataset and compare which fits the best.

 

Zhiwu
Level I

Re: Validation for Logistic regression model JMP 15

You can first fit your model using training dataset, the save prediction formula for each of models. Then using fit Y by X with your Y value in validation set and test set and X value is prediction formula from you models. Then by doing fit line or fit special with 45 degree line you will get all statistics number in output.

Recommended Articles