cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
%3CLINGO-SUB%20id%3D%22lingo-sub-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%E5%B0%8D%E6%8E%92%E9%99%A4%E8%A1%8C%E7%9A%84%E4%B8%80%E8%87%B4%E8%99%95%E7%90%86%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CP%3E%E4%BD%A0%E5%A5%BD%EF%BC%8C%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3E%E7%94%B1%E6%96%BC%E6%88%91%E8%AA%8D%E7%82%BA%20JMP%20%E4%B8%AD%E5%AD%98%E5%9C%A8%E9%8C%AF%E8%AA%A4%EF%BC%8C%E5%9B%A0%E6%AD%A4%E6%88%91%E8%88%87%20JMP%20%E6%94%AF%E6%8F%B4%E4%BA%BA%E5%93%A1%E9%80%B2%E8%A1%8C%E4%BA%86%E4%BA%A4%E8%AB%87%E3%80%82%E7%84%B6%E8%80%8C%EF%BC%8C%E6%88%91%E5%AD%B8%E5%88%B0%E4%BA%86%E4%BB%A5%E4%B8%8B%E5%B9%BE%E9%BB%9E%EF%BC%9A%3C%2FP%3E%0A%3CP%3E-%20%E5%A6%82%E6%9E%9C%E5%B0%87%E6%9F%90%E4%BA%9B%E8%A1%8C%E6%A8%99%E8%A8%98%E7%82%BA%E3%80%8C%E6%8E%92%E9%99%A4%E3%80%8D%EF%BC%88%E7%84%A1%E8%AB%96%E6%98%AF%E5%90%A6%E9%81%B8%E6%93%87%E5%8F%AF%E8%A6%8B%E6%88%96%E4%B8%8D%E5%8F%AF%E8%A6%8B%EF%BC%89%EF%BC%8C%E5%AE%83%E5%80%91%E5%B0%87%E5%BE%9E%E8%A8%B1%E5%A4%9A%E8%A8%88%E7%AE%97%E4%B8%AD%E5%88%AA%E9%99%A4%EF%BC%88%E4%BE%8B%E5%A6%82%EF%BC%8C%E8%A3%BD%E4%BD%9C%E7%9B%B4%E6%96%B9%E5%9C%96%E4%B8%8D%E6%9C%83%E8%80%83%E6%85%AE%E6%8E%92%E9%99%A4%E7%9A%84%E8%A1%8C%EF%BC%89%3C%2FP%3E%0A%3CP%3E-%20%E5%A6%82%E6%9E%9C%E5%B0%87%E6%9F%90%E4%BA%9B%E8%A1%8C%E6%A8%99%E8%A8%98%E7%82%BA%E3%80%8C%E6%8E%92%E9%99%A4%E3%80%8D%EF%BC%88%E7%84%A1%E8%AB%96%E6%98%AF%E5%90%A6%E9%81%B8%E6%93%87%E5%8F%AF%E8%A6%8B%E6%88%96%E4%B8%8D%E5%8F%AF%E8%A6%8B%EF%BC%89%EF%BC%8C%E5%AE%83%E5%80%91%E5%B0%87%E4%BD%9C%E7%82%BA%E5%A2%9E%E5%BC%B7%E6%A8%B9%E6%88%96%E5%BC%95%E5%B0%8E%E6%A3%AE%E6%9E%97%E7%AD%89%E5%B9%B3%E5%8F%B0%E7%9A%84%E9%A9%97%E8%AD%89%E9%9B%86%3CSTRONG%3E%E5%8C%85%E5%90%AB%E5%9C%A8%E5%85%A7%3C%2FSTRONG%3E%E3%80%82%3C%2FP%3E%0A%3CP%3E%E9%A1%AF%E7%84%B6%E9%80%99%E6%98%AF%E6%9C%89%E6%84%8F%E7%9A%84%E8%A1%8C%E7%82%BA%E3%80%82%E5%B0%B1%E6%88%91%E5%80%8B%E4%BA%BA%E8%80%8C%E8%A8%80%EF%BC%8C%E9%80%99%E8%AE%93%E6%88%91%E6%84%9F%E5%88%B0%E5%9B%B0%E6%83%91%EF%BC%8C%E5%B9%B8%E9%81%8B%E7%9A%84%E6%98%AF%EF%BC%8C%E6%88%91%E5%9C%A8%E7%99%BC%E5%B8%83%E7%B5%90%E6%9E%9C%E4%B9%8B%E5%89%8D%E8%81%AF%E7%B9%AB%E4%BA%86%E6%94%AF%E6%8F%B4%E4%BA%BA%E5%93%A1%E4%BB%A5%E4%BA%86%E8%A7%A3%E5%AE%83%EF%BC%8C%E5%9B%A0%E7%82%BA%E5%9C%A8%E6%88%91%E7%9A%84%E6%83%85%E6%B3%81%E4%B8%8B%EF%BC%8C%E6%8E%92%E9%99%A4%E7%9A%84%E8%A1%8C%E6%98%AF%E7%84%A1%E6%95%88%E8%B3%87%E6%96%99%E3%80%82%E6%88%91%E4%BF%9D%E7%95%99%E9%80%99%E4%BA%9B%E5%8F%AA%E6%98%AF%E7%82%BA%E4%BA%86%E8%B7%9F%E8%B8%AA%E7%9B%AE%E7%9A%84%E3%80%82%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3E%3CU%3E%E9%82%A3%E9%BA%BC%EF%BC%8C%E6%9C%80%E5%BE%8C%E6%88%91%E7%9A%84%E9%A1%98%E6%9C%9B%E6%98%AF%EF%BC%9AJMP%20%E5%9C%A8%E6%8E%92%E9%99%A4%E8%A1%8C%E7%9A%84%E4%BD%BF%E7%94%A8%E4%B8%8A%E8%83%BD%E5%AE%8C%E5%85%A8%E4%B8%80%E8%87%B4%E5%97%8E%EF%BC%9F%3C%2FU%3E%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3E%E4%BB%A5%E4%B8%8B%E6%98%AF%20JMP%3CFONT%20size%3D%223%22%3E%E6%94%AF%E6%8F%B4%E4%BA%BA%E5%93%A1%3C%2FFONT%3E%E5%AF%84%E7%B5%A6%E6%88%91%E7%9A%84%E4%B8%80%E5%8F%A5%E8%A9%B1%EF%BC%9A%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E%E3%80%8CBootstrap%20Forest%20%E5%92%8C%20JMP%20Pro%20%E4%B8%AD%E7%9A%84%E5%85%B6%E4%BB%96%E5%B9%BE%E5%80%8B%E5%B9%B3%E5%8F%B0%E9%83%BD%E6%9C%89%E4%B8%80%E5%80%8B%E5%8A%9F%E8%83%BD%EF%BC%8C%E5%8D%B3%E5%A6%82%E6%9E%9C%E6%8E%92%E9%99%A4%E6%9F%90%E4%BA%9B%E8%A1%8C%EF%BC%8C%E4%B8%94%E6%82%A8%E6%B2%92%E6%9C%89%E5%8F%A6%E5%A4%96%E6%8C%87%E5%AE%9A%E9%A9%97%E8%AD%89%E9%9B%86%EF%BC%8C%E5%89%87%E9%80%99%E4%BA%9B%E8%A1%8C%E5%B0%87%E7%94%A8%E4%BD%9C%E9%A9%97%E8%AD%89%E9%9B%86%E3%80%82%3C%2FSPAN%3E%3C%2FFONT%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E%E7%82%BA%E4%BA%86%E9%81%BF%E5%85%8D%E5%8C%85%E5%90%AB%E9%80%99%E4%BA%9B%E8%A1%8C%EF%BC%8C%E6%82%A8%E5%8F%AF%E4%BB%A5%EF%BC%9A%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E1)%20%E5%B0%87%E8%B3%87%E6%96%99%E8%A1%A8%E5%AD%90%E9%9B%86%E5%8C%96%EF%BC%8C%E4%BD%BF%E5%85%B6%E4%B8%8D%E5%8C%85%E5%90%AB%E9%80%99%E4%BA%9B%E8%A1%8C%EF%BC%8C%E7%84%B6%E5%BE%8C%E9%87%8D%E6%96%B0%E5%9F%B7%E8%A1%8C%20Bootstrap%20Forest%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E2)%20%E4%BD%BF%E7%94%A8%E4%B8%8D%E5%90%8C%E7%9A%84%E9%A9%97%E8%AD%89%E6%96%B9%E6%B3%95%EF%BC%88%E4%BF%9D%E7%95%99%E6%88%96%E9%A9%97%E8%AD%89%E5%88%97%EF%BC%89%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E%E4%B8%80%E8%88%AC%E4%BE%86%E8%AA%AA%EF%BC%8C%E5%B0%87%E4%B8%80%E4%BA%9B%E8%A1%8C%E7%94%A8%E6%96%BC%E9%A9%97%E8%AD%89%E9%9B%86%E9%80%9A%E5%B8%B8%E6%98%AF%E4%B8%80%E5%80%8B%E5%A5%BD%E4%B8%BB%E6%84%8F%E3%80%82%E9%80%99%E5%B0%87%E4%BD%BF%E6%82%A8%E8%83%BD%E5%A4%A0%E4%BD%BF%E7%94%A8%E2%80%9C%E6%8F%90%E5%89%8D%E5%81%9C%E6%AD%A2%E2%80%9D%E9%81%B8%E9%A0%85%EF%BC%8C%E9%80%99%E6%9C%89%E5%8A%A9%E6%96%BC%E9%81%BF%E5%85%8D%E9%81%8E%E5%BA%A6%E6%93%AC%E5%90%88%E3%80%82%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%20%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CLINGO-LABEL%3E%E9%A0%90%E6%B8%AC%E5%BB%BA%E6%A8%A1%E5%92%8C%E6%A9%9F%E5%99%A8%E5%AD%B8%E7%BF%92%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-245755%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%E5%9B%9E%E5%A4%8D%EF%BC%9A%E6%8E%92%E9%99%A4%E8%A1%8C%E7%9A%84%E4%B8%80%E8%87%B4%E8%99%95%E7%90%86%20-%20%E7%8B%80%E6%85%8B%E6%9B%B4%E6%94%B9%E7%82%BA%EF%BC%9A%E5%B7%B2%E4%BA%A4%E4%BB%98%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-245755%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CP%3E%E5%BE%9E%20JMP%2015%20%E9%96%8B%E5%A7%8B%EF%BC%8C%E6%8E%92%E9%99%A4%E7%9A%84%E8%A1%8C%E4%B8%8D%E6%9C%83%E7%94%A8%E6%96%BC%E9%A9%97%E8%AD%89%EF%BC%8C%E9%99%A4%E9%9D%9E%E6%82%A8%E6%8F%90%E4%BA%A4%20JSL%EF%BC%9A%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CPRE%3EUse%20Excluded%20Rows%20for%20Validation(1)%3C%2FPRE%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E
Choose Language Hide Translation Bar
0 Kudos

Consistent handling of excluded rows

Hi,

 

I had a conversation with JMP support since I assumed a bug in JMP. However, I learned the following:

- If one marks certain rows as "excluded" (no matter if chosen visible or nor) they will be removed from many computations (e.g. doing a histogram does not take excluded rows into account)

- If one marks certain rows as "excluded" (no matter if chosen visible or nor) they will be included as a validation set for platforms like boosted tree or bootstrap forest.

Apparently this is intended behavior. Personally, it confused me and fortunately I got in contact with support to learn about it before I published the results, since in my case the excluded rows are invalid data. I just keep those for tracking purposes.

 

So, finally my wish: could JMP be fully consistent in the use of excluded rows?

 

Here's a quote that JMP support sent me:

"The Bootstrap Forest and several other platforms in JMP Pro have a feature that if some rows are excluded, and you do not otherwise specify a Validation set, those rows are used as the Validation set. To avoid those rows from being included at all, you could:

1) Subset the data table so it doesn't include those rows, then re-run the Bootstrap Forest

2) Use a different Validation method (Holdback or Validation Column)

In general, it is often a good idea to devote some rows to a Validation set. This would give you the ability to use the Early Stopping option, which can help avoid overfitting."

 

1 Comment
Jeff_Perkinson
Community Manager
Status changed to: Delivered

Starting in JMP 15 excluded rows are not used for Validation unless you submit the JSL:

 

Use Excluded Rows for Validation(1)