cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
%3CLINGO-SUB%20id%3D%22lingo-sub-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3EManejo%20consistente%20de%20filas%20excluidas%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CP%3EHola%2C%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3ETuve%20una%20conversaci%C3%B3n%20con%20el%20soporte%20de%20JMP%20porque%20supuse%20que%20hab%C3%ADa%20un%20error%20en%20JMP.%20Sin%20embargo%2C%20aprend%C3%AD%20lo%20siguiente%3A%3C%2FP%3E%0A%3CP%3E-%20Si%20se%20marcan%20ciertas%20filas%20como%20%22excluidas%22%20(sin%20importar%20si%20se%20eligen%20visibles%20o%20no)%2C%20se%20eliminar%C3%A1n%20de%20muchos%20c%C3%A1lculos%20(por%20ejemplo%2C%20al%20hacer%20un%20histograma%20no%20se%20tienen%20en%20cuenta%20las%20filas%20excluidas).%3C%2FP%3E%0A%3CP%3E-%20Si%20se%20marcan%20ciertas%20filas%20como%20%22excluidas%22%20(sin%20importar%20si%20se%20eligen%20visibles%20o%20no)%2C%20se%20%3CSTRONG%3Eincluir%C3%A1n%3C%2FSTRONG%3E%20como%20un%20conjunto%20de%20validaci%C3%B3n%20para%20plataformas%20como%20%C3%A1rbol%20impulsado%20o%20bosque%20de%20arranque.%3C%2FP%3E%0A%3CP%3EAparentemente%20este%20es%20el%20comportamiento%20previsto.%20Personalmente%20me%20confundi%C3%B3%20y%20afortunadamente%20me%20puse%20en%20contacto%20con%20soporte%20para%20informarme%20antes%20de%20publicar%20los%20resultados%2C%20ya%20que%20en%20mi%20caso%20las%20filas%20excluidas%20son%20datos%20no%20v%C3%A1lidos.%20S%C3%B3lo%20los%20guardo%20para%20fines%20de%20seguimiento.%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3E%3CU%3EEntonces%2C%20finalmente%20mi%20deseo%3A%20%C2%BFpodr%C3%ADa%20JMP%20ser%20totalmente%20consistente%20en%20el%20uso%20de%20filas%20excluidas%3F%3C%2FU%3E%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3EAqu%C3%AD%20hay%20una%20cita%20que%20me%20envi%C3%B3%20%3CFONT%20size%3D%223%22%3Eel%20soporte%3C%2FFONT%3E%20de%20JMP%3A%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E%22El%20bosque%20Bootstrap%20y%20varias%20otras%20plataformas%20en%20JMP%20Pro%20tienen%20una%20caracter%C3%ADstica%20que%20si%20se%20excluyen%20algunas%20filas%20y%20no%20se%20especifica%20un%20conjunto%20de%20validaci%C3%B3n%2C%20esas%20filas%20se%20utilizan%20como%20conjunto%20de%20validaci%C3%B3n.%3C%2FSPAN%3E%3C%2FFONT%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3EPara%20evitar%20que%20esas%20filas%20se%20incluyan%2C%20podr%C3%ADas%3A%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E1)%20Subconjunto%20de%20la%20tabla%20de%20datos%20para%20que%20no%20incluya%20esas%20filas%2C%20luego%20vuelva%20a%20ejecutar%20Bootstrap%20Forest%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E2)%20Utilice%20un%20m%C3%A9todo%20de%20validaci%C3%B3n%20diferente%20(columna%20de%20retenci%C3%B3n%20o%20validaci%C3%B3n)%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3EEn%20general%2C%20suele%20ser%20una%20buena%20idea%20dedicar%20algunas%20filas%20a%20un%20conjunto%20de%20Validaci%C3%B3n.%20Esto%20le%20dar%C3%ADa%20la%20posibilidad%20de%20utilizar%20la%20opci%C3%B3n%20de%20parada%20anticipada%2C%20que%20puede%20ayudar%20a%20evitar%20el%20sobreajuste%22.%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%20%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CLINGO-LABEL%3EModelado%20predictivo%20y%20aprendizaje%20autom%C3%A1tico%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-245755%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3ERe%3A%20Manejo%20consistente%20de%20filas%20excluidas%20-%20Estado%20cambiado%20a%3A%20Entregado%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-245755%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CP%3EA%20partir%20de%20JMP%2C%2015%20filas%20excluidas%20no%20se%20utilizan%20para%20la%20validaci%C3%B3n%20a%20menos%20que%20env%C3%ADe%20el%20JSL%3A%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CPRE%3EUse%20Excluded%20Rows%20for%20Validation(1)%3C%2FPRE%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E
Choose Language Hide Translation Bar
0 Kudos

Consistent handling of excluded rows

Hi,

 

I had a conversation with JMP support since I assumed a bug in JMP. However, I learned the following:

- If one marks certain rows as "excluded" (no matter if chosen visible or nor) they will be removed from many computations (e.g. doing a histogram does not take excluded rows into account)

- If one marks certain rows as "excluded" (no matter if chosen visible or nor) they will be included as a validation set for platforms like boosted tree or bootstrap forest.

Apparently this is intended behavior. Personally, it confused me and fortunately I got in contact with support to learn about it before I published the results, since in my case the excluded rows are invalid data. I just keep those for tracking purposes.

 

So, finally my wish: could JMP be fully consistent in the use of excluded rows?

 

Here's a quote that JMP support sent me:

"The Bootstrap Forest and several other platforms in JMP Pro have a feature that if some rows are excluded, and you do not otherwise specify a Validation set, those rows are used as the Validation set. To avoid those rows from being included at all, you could:

1) Subset the data table so it doesn't include those rows, then re-run the Bootstrap Forest

2) Use a different Validation method (Holdback or Validation Column)

In general, it is often a good idea to devote some rows to a Validation set. This would give you the ability to use the Early Stopping option, which can help avoid overfitting."

 

1 Comment
Jeff_Perkinson
Community Manager
Status changed to: Delivered

Starting in JMP 15 excluded rows are not used for Validation unless you submit the JSL:

 

Use Excluded Rows for Validation(1)