cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
%3CLINGO-SUB%20id%3D%22lingo-sub-213304%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3EDie%20Kreuzvalidierungs-Verwirrungsmatrix%20sollte%20alle%20kreuzvalidierten%20Daten%20enthalten%2C%20nicht%20nur%20die%20letzten%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-213304%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CP%3EVorhersagemodelle%20mit%20bin%C3%A4rem%20Y%2C%20die%20eine%20Kreuzvalidierung%20erm%C3%B6glichen%2C%20z.%20B.%20k-fach%20oder%20auslassen%2C%20spiegeln%20die%20Verwirrungsmatrix%20nur%20die%20letzte%20Iteration%20der%20Kreuzklassifikation%20wider.%20Zum%20Beispiel%20enth%C3%A4lt%20der%20Trainingssatz%20bei%205-facher%20Kreuzvalidierung%2080%25%20der%20Daten%20und%20der%20Validierungssatz%2020%25.%26nbsp%3B%20Der%20Validierungssatz%20sollte%20alle%205%20Falten%20der%20Daten%20kombinieren%2C%20um%20100%25%20anzuzeigen.%26nbsp%3B%20Zum%20Auslassen%20ist%20es%20noch%20nutzloser%2C%20da%20der%20Validierungssatz%20nur%20eine%20einzige%20Beobachtung%20enth%C3%A4lt.%26nbsp%3B%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-213304%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CLINGO-LABEL%3EStatistik%20und%20Analytik%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Choose Language Hide Translation Bar

cross validation confusion matrix should include all cross validated data not just last

Predictive models with binary Y that allow cross validation, eg k-fold or leave one out, the confusion matrix reflect only the last iteration of the cross classification. For example in 5-fold cross validation the training set has 80% of the data and the Validation set shows 20%.  The validation set should combine all 5 folds of the data to show 100%.  For leave one out it is even more useless as the validation set only has a single observation.  

1 Comment
Ryan_Gilmore
Community Manager
Status changed to: Archived
We are archiving this request. If this is still important please comment with additional details and we will reopen. Thank you!