cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
%3CLINGO-SUB%20id%3D%22lingo-sub-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%EC%A0%9C%EC%99%B8%EB%90%9C%20%ED%96%89%EC%9D%98%20%EC%9D%BC%EA%B4%80%EB%90%9C%20%EC%B2%98%EB%A6%AC%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CP%3E%EC%95%88%EB%85%95%2C%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3EJMP%EC%97%90%20%EB%B2%84%EA%B7%B8%EA%B0%80%20%EC%9E%88%EB%8B%A4%EA%B3%A0%20%EA%B0%80%EC%A0%95%ED%95%9C%20%EC%9D%B4%ED%9B%84%EB%A1%9C%20JMP%20%EC%A7%80%EC%9B%90%ED%8C%80%EA%B3%BC%20%EB%8C%80%ED%99%94%EB%A5%BC%20%EB%82%98%EB%88%B4%EC%8A%B5%EB%8B%88%EB%8B%A4.%20%EA%B7%B8%EB%9F%AC%EB%82%98%20%EB%82%98%EB%8A%94%20%EB%8B%A4%EC%9D%8C%EA%B3%BC%20%EA%B0%99%EC%9D%80%20%EC%82%AC%EC%8B%A4%EC%9D%84%20%EB%B0%B0%EC%9B%A0%EC%8A%B5%EB%8B%88%EB%8B%A4.%3C%2FP%3E%0A%3CP%3E-%20%ED%8A%B9%EC%A0%95%20%ED%96%89%EC%9D%84%20%22%EC%A0%9C%EC%99%B8%EB%90%A8%22%EC%9C%BC%EB%A1%9C%20%ED%91%9C%EC%8B%9C%ED%95%98%EB%A9%B4(%ED%91%9C%EC%8B%9C%20%EC%97%AC%EB%B6%80%EC%97%90%20%EA%B4%80%EA%B3%84%EC%97%86%EC%9D%B4)%20%EB%A7%8E%EC%9D%80%20%EA%B3%84%EC%82%B0%EC%97%90%EC%84%9C%20%EC%A0%9C%EA%B1%B0%EB%90%A9%EB%8B%88%EB%8B%A4(%EC%98%88%3A%20%ED%9E%88%EC%8A%A4%ED%86%A0%EA%B7%B8%EB%9E%A8%EC%9D%84%20%EC%88%98%ED%96%89%ED%95%98%EB%A9%B4%20%EC%A0%9C%EC%99%B8%EB%90%9C%20%ED%96%89%EC%9D%B4%20%EA%B3%A0%EB%A0%A4%EB%90%98%EC%A7%80%20%EC%95%8A%EC%8A%B5%EB%8B%88%EB%8B%A4).%3C%2FP%3E%0A%3CP%3E-%20%ED%8A%B9%EC%A0%95%20%ED%96%89%EC%9D%84%20%22%EC%A0%9C%EC%99%B8%EB%90%A8%22%EC%9C%BC%EB%A1%9C%20%ED%91%9C%EC%8B%9C%ED%95%98%EB%A9%B4(%ED%91%9C%EC%8B%9C%20%EC%97%AC%EB%B6%80%EC%97%90%20%EA%B4%80%EA%B3%84%EC%97%86%EC%9D%B4)%20%EB%B6%80%EC%8A%A4%ED%8C%85%20%ED%8A%B8%EB%A6%AC%20%EB%98%90%EB%8A%94%20%EB%B6%80%ED%8A%B8%EC%8A%A4%ED%8A%B8%EB%9E%A9%20%ED%8F%AC%EB%A6%AC%EC%8A%A4%ED%8A%B8%EC%99%80%20%EA%B0%99%EC%9D%80%20%ED%94%8C%EB%9E%AB%ED%8F%BC%EC%97%90%20%EB%8C%80%ED%95%9C%20%EC%9C%A0%ED%9A%A8%EC%84%B1%20%EA%B2%80%EC%82%AC%20%EC%84%B8%ED%8A%B8%EB%A1%9C%20%3CSTRONG%3E%ED%8F%AC%ED%95%A8%3C%2FSTRONG%3E%20%EB%90%A9%EB%8B%88%EB%8B%A4.%3C%2FP%3E%0A%3CP%3E%EB%B6%84%EB%AA%85%ED%9E%88%20%EC%9D%B4%EB%8A%94%20%EC%9D%98%EB%8F%84%EB%90%9C%20%EB%8F%99%EC%9E%91%EC%9E%85%EB%8B%88%EB%8B%A4.%20%EA%B0%9C%EC%9D%B8%EC%A0%81%EC%9C%BC%EB%A1%9C%EB%8A%94%20%ED%98%BC%EB%9E%80%EC%8A%A4%EB%9F%AC%EC%9B%A0%EA%B3%A0%20%EB%8B%A4%ED%96%89%ED%9E%88%EB%8F%84%20%EA%B2%B0%EA%B3%BC%EB%A5%BC%20%EA%B2%8C%EC%8B%9C%ED%95%98%EA%B8%B0%20%EC%A0%84%EC%97%90%20%EC%9D%B4%EC%97%90%20%EB%8C%80%ED%95%B4%20%EC%95%8C%EC%95%84%EB%B3%B4%EA%B8%B0%20%EC%9C%84%ED%95%B4%20%EC%A7%80%EC%9B%90%ED%8C%80%EC%97%90%20%EC%97%B0%EB%9D%BD%ED%96%88%EC%8A%B5%EB%8B%88%EB%8B%A4.%20%EC%A0%9C%20%EA%B2%BD%EC%9A%B0%EC%97%90%EB%8A%94%20%EC%A0%9C%EC%99%B8%EB%90%9C%20%ED%96%89%EC%9D%B4%20%EC%9C%A0%ED%9A%A8%ED%95%98%EC%A7%80%20%EC%95%8A%EC%9D%80%20%EB%8D%B0%EC%9D%B4%ED%84%B0%EC%9D%B4%EA%B8%B0%20%EB%95%8C%EB%AC%B8%EC%9E%85%EB%8B%88%EB%8B%A4.%20%EC%B6%94%EC%A0%81%20%EB%AA%A9%EC%A0%81%EC%9C%BC%EB%A1%9C%EB%A7%8C%20%EB%B3%B4%EA%B4%80%ED%95%A9%EB%8B%88%EB%8B%A4.%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3E%3CU%3E%EB%A7%88%EC%A7%80%EB%A7%89%EC%9C%BC%EB%A1%9C%20%EC%A0%9C%20%EB%B0%94%EB%9E%8C%EC%9D%80%20JMP%EA%B0%80%20%EC%A0%9C%EC%99%B8%EB%90%9C%20%ED%96%89%EC%9D%84%20%EC%82%AC%EC%9A%A9%ED%95%A0%20%EB%95%8C%20%EC%99%84%EC%A0%84%ED%9E%88%20%EC%9D%BC%EA%B4%80%EC%84%B1%EC%9D%84%20%EA%B0%80%EC%A7%88%20%EC%88%98%20%EC%9E%88%EC%9D%84%EA%B9%8C%EC%9A%94%3F%3C%2FU%3E%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3EJMP%20%3CFONT%20size%3D%223%22%3E%EC%A7%80%EC%9B%90%ED%8C%80%3C%2FFONT%3E%20%EC%97%90%EC%84%9C%20%EB%B3%B4%EB%82%B8%20%EC%9D%B8%EC%9A%A9%EB%AC%B8%EC%9D%80%20%EB%8B%A4%EC%9D%8C%EA%B3%BC%20%EA%B0%99%EC%8A%B5%EB%8B%88%EB%8B%A4.%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E%22JMP%20Pro%EC%9D%98%20Bootstrap%20Forest%EC%99%80%20%EA%B8%B0%ED%83%80%20%EC%97%AC%EB%9F%AC%20%ED%94%8C%EB%9E%AB%ED%8F%BC%EC%97%90%EB%8A%94%20%EC%9D%BC%EB%B6%80%20%ED%96%89%EC%9D%B4%20%EC%A0%9C%EC%99%B8%EB%90%98%EA%B3%A0%20%EA%B2%80%EC%A6%9D%20%EC%84%B8%ED%8A%B8%EB%A5%BC%20%EB%B3%84%EB%8F%84%EB%A1%9C%20%EC%A7%80%EC%A0%95%ED%95%98%EC%A7%80%20%EC%95%8A%EC%9C%BC%EB%A9%B4%20%ED%95%B4%EB%8B%B9%20%ED%96%89%EC%9D%B4%20%EA%B2%80%EC%A6%9D%20%EC%84%B8%ED%8A%B8%EB%A1%9C%20%EC%82%AC%EC%9A%A9%EB%90%98%EB%8A%94%20%EA%B8%B0%EB%8A%A5%EC%9D%B4%20%EC%9E%88%EC%8A%B5%EB%8B%88%EB%8B%A4.%3C%2FSPAN%3E%3C%2FFONT%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E%ED%95%B4%EB%8B%B9%20%ED%96%89%EC%9D%B4%20%EC%A0%84%ED%98%80%20%ED%8F%AC%ED%95%A8%EB%90%98%EC%A7%80%20%EC%95%8A%EB%8F%84%EB%A1%9D%20%ED%95%98%EB%A0%A4%EB%A9%B4%20%EB%8B%A4%EC%9D%8C%EC%9D%84%20%EC%88%98%ED%96%89%ED%95%A0%20%EC%88%98%20%EC%9E%88%EC%8A%B5%EB%8B%88%EB%8B%A4.%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E1)%20%ED%95%B4%EB%8B%B9%20%ED%96%89%EC%9D%84%20%ED%8F%AC%ED%95%A8%ED%95%98%EC%A7%80%20%EC%95%8A%EB%8F%84%EB%A1%9D%20%EB%8D%B0%EC%9D%B4%ED%84%B0%20%ED%85%8C%EC%9D%B4%EB%B8%94%EC%9D%98%20%ED%95%98%EC%9C%84%20%EC%A7%91%ED%95%A9%EC%9D%84%20%EB%A7%8C%EB%93%A0%20%EB%8B%A4%EC%9D%8C%20Bootstrap%20Forest%EB%A5%BC%20%EB%8B%A4%EC%8B%9C%20%EC%8B%A4%ED%96%89%ED%95%A9%EB%8B%88%EB%8B%A4.%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E2)%20%EB%8B%A4%EB%A5%B8%20%EA%B2%80%EC%A6%9D%20%EB%B0%A9%EB%B2%95(%ED%99%80%EB%93%9C%EB%B0%B1%20%EB%98%90%EB%8A%94%20%EA%B2%80%EC%A6%9D%20%EC%97%B4)%EC%9D%84%20%EC%82%AC%EC%9A%A9%ED%95%A9%EB%8B%88%EB%8B%A4.%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E%EC%9D%BC%EB%B0%98%EC%A0%81%EC%9C%BC%EB%A1%9C%20%EC%9D%BC%EB%B6%80%20%ED%96%89%EC%9D%84%20%EC%9C%A0%ED%9A%A8%EC%84%B1%20%EA%B2%80%EC%82%AC%20%EC%84%B8%ED%8A%B8%EC%97%90%20%ED%95%A0%EB%8B%B9%ED%95%98%EB%8A%94%20%EA%B2%83%EC%9D%B4%20%EC%A2%8B%EC%9D%80%20%EA%B2%BD%EC%9A%B0%EA%B0%80%20%EB%A7%8E%EC%8A%B5%EB%8B%88%EB%8B%A4.%20%EC%9D%B4%EB%A0%87%EA%B2%8C%20%ED%95%98%EB%A9%B4%20%EC%A1%B0%EA%B8%B0%20%EC%A4%91%EC%A7%80%20%EC%98%B5%EC%85%98%EC%9D%84%20%EC%82%AC%EC%9A%A9%ED%95%A0%20%EC%88%98%20%EC%9E%88%EC%96%B4%20%EA%B3%BC%EC%A0%81%ED%95%A9%EC%9D%84%20%EB%B0%A9%EC%A7%80%ED%95%98%EB%8A%94%20%EB%8D%B0%20%EB%8F%84%EC%9B%80%EC%9D%B4%20%EB%90%A9%EB%8B%88%EB%8B%A4.%22%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%20%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CLINGO-LABEL%3E%EC%98%88%EC%B8%A1%20%EB%AA%A8%EB%8D%B8%EB%A7%81%20%EB%B0%8F%20%EA%B8%B0%EA%B3%84%20%ED%95%99%EC%8A%B5%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-245755%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3ERe%20%3A%20%EC%A0%9C%EC%99%B8%20%EB%90%9C%20%ED%96%89%EC%9D%98%20%EC%9D%BC%EA%B4%80%EB%90%9C%20%EC%B2%98%EB%A6%AC-%EC%83%81%ED%83%9C%EA%B0%80%20%EB%8B%A4%EC%9D%8C%EC%9C%BC%EB%A1%9C%20%EB%B3%80%EA%B2%BD%EB%90%A8%20%3A%20%EB%B0%B0%EB%8B%AC%20%EB%90%A8%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-245755%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CP%3EJMP%2015%EB%B6%80%ED%84%B0%20%EC%A0%9C%EC%99%B8%20%EB%90%9C%20%ED%96%89%EC%9D%80%20JSL%EC%9D%84%20%EC%A0%9C%EC%B6%9C%ED%95%98%EC%A7%80%20%EC%95%8A%EB%8A%94%20%ED%95%9C%20%EC%9C%A0%ED%9A%A8%EC%84%B1%20%EA%B2%80%EC%82%AC%EC%97%90%20%EC%82%AC%EC%9A%A9%EB%90%98%EC%A7%80%20%EC%95%8A%EC%8A%B5%EB%8B%88%EB%8B%A4.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CPRE%3EUse%20Excluded%20Rows%20for%20Validation(1)%3C%2FPRE%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E
Choose Language Hide Translation Bar
0 Kudos

Consistent handling of excluded rows

Hi,

 

I had a conversation with JMP support since I assumed a bug in JMP. However, I learned the following:

- If one marks certain rows as "excluded" (no matter if chosen visible or nor) they will be removed from many computations (e.g. doing a histogram does not take excluded rows into account)

- If one marks certain rows as "excluded" (no matter if chosen visible or nor) they will be included as a validation set for platforms like boosted tree or bootstrap forest.

Apparently this is intended behavior. Personally, it confused me and fortunately I got in contact with support to learn about it before I published the results, since in my case the excluded rows are invalid data. I just keep those for tracking purposes.

 

So, finally my wish: could JMP be fully consistent in the use of excluded rows?

 

Here's a quote that JMP support sent me:

"The Bootstrap Forest and several other platforms in JMP Pro have a feature that if some rows are excluded, and you do not otherwise specify a Validation set, those rows are used as the Validation set. To avoid those rows from being included at all, you could:

1) Subset the data table so it doesn't include those rows, then re-run the Bootstrap Forest

2) Use a different Validation method (Holdback or Validation Column)

In general, it is often a good idea to devote some rows to a Validation set. This would give you the ability to use the Early Stopping option, which can help avoid overfitting."

 

1 Comment
Jeff_Perkinson
Community Manager
Status changed to: Delivered

Starting in JMP 15 excluded rows are not used for Validation unless you submit the JSL:

 

Use Excluded Rows for Validation(1)