cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
%3CLINGO-SUB%20id%3D%22lingo-sub-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3EGestione%20coerente%20delle%20righe%20escluse%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CP%3ECIAO%2C%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3EHo%20avuto%20una%20conversazione%20con%20il%20supporto%20JMP%20poich%C3%A9%20presumevo%20che%20ci%20fosse%20un%20bug%20in%20JMP.%20Tuttavia%2C%20ho%20imparato%20quanto%20segue%3A%3C%2FP%3E%0A%3CP%3E-%20Se%20si%20contrassegnano%20determinate%20righe%20come%20%22escluse%22%20(non%20importa%20se%20scelte%20come%20visibili%20o%20meno)%20verranno%20rimosse%20da%20molti%20calcoli%20(ad%20esempio%2C%20facendo%20un%20istogramma%20non%20si%20tengono%20in%20considerazione%20le%20righe%20escluse)%3C%2FP%3E%0A%3CP%3E-%20Se%20si%20contrassegnano%20determinate%20righe%20come%20%22escluse%22%20(non%20importa%20se%20scelte%20come%20visibili%20o%20no)%2C%20verranno%20%3CSTRONG%3Eincluse%3C%2FSTRONG%3E%20come%20set%20di%20convalida%20per%20piattaforme%20come%20albero%20potenziato%20o%20foresta%20bootstrap.%3C%2FP%3E%0A%3CP%3EApparentemente%20questo%20%C3%A8%20un%20comportamento%20previsto.%20Personalmente%20mi%20ha%20confuso%20e%20fortunatamente%20ho%20contattato%20l'assistenza%20per%20informarmi%20prima%20di%20pubblicare%20i%20risultati%2C%20poich%C3%A9%20nel%20mio%20caso%20le%20righe%20escluse%20sono%20dati%20non%20validi.%20Li%20tengo%20solo%20a%20scopo%20di%20monitoraggio.%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3E%3CU%3EQuindi%2C%20infine%2C%20il%20mio%20desiderio%3A%20JMP%20potrebbe%20essere%20pienamente%20coerente%20nell'uso%20delle%20righe%20escluse%3F%3C%2FU%3E%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3EEcco%20una%20citazione%20che%20mi%20ha%20inviato%20%3CFONT%20size%3D%223%22%3Eil%20supporto%3C%2FFONT%3E%20JMP%3A%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E%22La%20foresta%20Bootstrap%20e%20diverse%20altre%20piattaforme%20in%20JMP%20Pro%20dispongono%20di%20una%20funzionalit%C3%A0%20secondo%20cui%20se%20alcune%20righe%20vengono%20escluse%20e%20non%20si%20specifica%20altrimenti%20un%20set%20di%20convalida%2C%20tali%20righe%20vengono%20utilizzate%20come%20set%20di%20convalida.%3C%2FSPAN%3E%3C%2FFONT%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3EPer%20evitare%20che%20tali%20righe%20vengano%20incluse%2C%20potresti%3A%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E1)%20Sottoimposta%20la%20tabella%20dati%20in%20modo%20che%20non%20includa%20quelle%20righe%2C%20quindi%20esegui%20nuovamente%20Bootstrap%20Forest%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E2)%20Utilizzare%20un%20metodo%20di%20convalida%20diverso%20(colonna%20Holdback%20o%20convalida)%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3EIn%20generale%2C%20spesso%20%C3%A8%20una%20buona%20idea%20dedicare%20alcune%20righe%20a%20un%20set%20di%20convalida.%20Ci%C3%B2%20ti%20darebbe%20la%20possibilit%C3%A0%20di%20utilizzare%20l'opzione%20di%20arresto%20anticipato%2C%20che%20pu%C3%B2%20aiutare%20a%20evitare%20l'overfitting.%22%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%20%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CLINGO-LABEL%3EModellazione%20predittiva%20e%20machine%20learning%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-245755%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3EOggetto%3A%20Gestione%20coerente%20delle%20righe%20escluse%20-%20Stato%20modificato%20in%3A%20Consegnato%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-245755%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CP%3EA%20partire%20da%20JMP%2015%20righe%20escluse%20non%20vengono%20utilizzate%20per%20la%20convalida%20a%20meno%20che%20non%20si%20invii%20il%20JSL%3A%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CPRE%3EUse%20Excluded%20Rows%20for%20Validation(1)%3C%2FPRE%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E
Choose Language Hide Translation Bar
0 Kudos

Consistent handling of excluded rows

Hi,

 

I had a conversation with JMP support since I assumed a bug in JMP. However, I learned the following:

- If one marks certain rows as "excluded" (no matter if chosen visible or nor) they will be removed from many computations (e.g. doing a histogram does not take excluded rows into account)

- If one marks certain rows as "excluded" (no matter if chosen visible or nor) they will be included as a validation set for platforms like boosted tree or bootstrap forest.

Apparently this is intended behavior. Personally, it confused me and fortunately I got in contact with support to learn about it before I published the results, since in my case the excluded rows are invalid data. I just keep those for tracking purposes.

 

So, finally my wish: could JMP be fully consistent in the use of excluded rows?

 

Here's a quote that JMP support sent me:

"The Bootstrap Forest and several other platforms in JMP Pro have a feature that if some rows are excluded, and you do not otherwise specify a Validation set, those rows are used as the Validation set. To avoid those rows from being included at all, you could:

1) Subset the data table so it doesn't include those rows, then re-run the Bootstrap Forest

2) Use a different Validation method (Holdback or Validation Column)

In general, it is often a good idea to devote some rows to a Validation set. This would give you the ability to use the Early Stopping option, which can help avoid overfitting."

 

1 Comment
Jeff_Perkinson
Community Manager
Status changed to: Delivered

Starting in JMP 15 excluded rows are not used for Validation unless you submit the JSL:

 

Use Excluded Rows for Validation(1)