cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
%3CLINGO-SUB%20id%3D%22lingo-sub-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%E4%B8%80%E8%87%B4%E5%A4%84%E7%90%86%E6%8E%92%E9%99%A4%E8%A1%8C%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CP%3E%E4%BD%A0%E5%A5%BD%EF%BC%8C%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3E%E7%94%B1%E4%BA%8E%E6%88%91%E6%80%80%E7%96%91%20JMP%20%E4%B8%AD%E5%AD%98%E5%9C%A8%E9%94%99%E8%AF%AF%EF%BC%8C%E5%9B%A0%E6%AD%A4%E6%88%91%E4%B8%8E%20JMP%20%E6%94%AF%E6%8C%81%E4%BA%BA%E5%91%98%E8%BF%9B%E8%A1%8C%E4%BA%86%E4%BA%A4%E6%B5%81%E3%80%82%E7%84%B6%E8%80%8C%EF%BC%8C%E6%88%91%E4%BA%86%E8%A7%A3%E5%88%B0%E4%BB%A5%E4%B8%8B%E6%83%85%E5%86%B5%EF%BC%9A%3C%2FP%3E%0A%3CP%3E-%20%E5%A6%82%E6%9E%9C%E5%B0%86%E6%9F%90%E4%BA%9B%E8%A1%8C%E6%A0%87%E8%AE%B0%E4%B8%BA%E2%80%9C%E6%8E%92%E9%99%A4%E2%80%9D%EF%BC%88%E6%97%A0%E8%AE%BA%E6%98%AF%E5%90%A6%E9%80%89%E6%8B%A9%E5%8F%AF%E8%A7%81%EF%BC%89%EF%BC%8C%E5%AE%83%E4%BB%AC%E5%B0%86%E4%BB%8E%E8%AE%B8%E5%A4%9A%E8%AE%A1%E7%AE%97%E4%B8%AD%E5%88%A0%E9%99%A4%EF%BC%88%E4%BE%8B%E5%A6%82%EF%BC%8C%E6%89%A7%E8%A1%8C%E7%9B%B4%E6%96%B9%E5%9B%BE%E6%97%B6%E4%B8%8D%E4%BC%9A%E8%80%83%E8%99%91%E6%8E%92%E9%99%A4%E7%9A%84%E8%A1%8C%EF%BC%89%3C%2FP%3E%0A%3CP%3E-%20%E5%A6%82%E6%9E%9C%E5%B0%86%E6%9F%90%E4%BA%9B%E8%A1%8C%E6%A0%87%E8%AE%B0%E4%B8%BA%E2%80%9C%E6%8E%92%E9%99%A4%E2%80%9D%EF%BC%88%E6%97%A0%E8%AE%BA%E6%98%AF%E5%90%A6%E9%80%89%E6%8B%A9%E5%8F%AF%E8%A7%81%EF%BC%89%EF%BC%8C%E5%AE%83%E4%BB%AC%E5%B0%86%E8%A2%AB%3CSTRONG%3E%E5%8C%85%E5%90%AB%3C%2FSTRONG%3E%E5%9C%A8%E8%AF%B8%E5%A6%82%E5%A2%9E%E5%BC%BA%E6%A0%91%E6%88%96%E5%BC%95%E5%AF%BC%E6%A3%AE%E6%9E%97%E7%AD%89%E5%B9%B3%E5%8F%B0%E7%9A%84%E9%AA%8C%E8%AF%81%E9%9B%86%E4%B9%8B%E4%B8%AD%E3%80%82%3C%2FP%3E%0A%3CP%3E%E6%98%BE%E7%84%B6%E8%BF%99%E6%98%AF%E6%9C%89%E6%84%8F%E4%B8%BA%E4%B9%8B%E3%80%82%E5%B0%B1%E6%88%91%E4%B8%AA%E4%BA%BA%E8%80%8C%E8%A8%80%EF%BC%8C%E8%BF%99%E8%AE%A9%E6%88%91%E5%BE%88%E5%9B%B0%E6%83%91%EF%BC%8C%E5%B9%B8%E8%BF%90%E7%9A%84%E6%98%AF%EF%BC%8C%E6%88%91%E5%9C%A8%E5%8F%91%E5%B8%83%E7%BB%93%E6%9E%9C%E4%B9%8B%E5%89%8D%E8%81%94%E7%B3%BB%E4%BA%86%E6%94%AF%E6%8C%81%E4%BA%BA%E5%91%98%E4%BA%86%E8%A7%A3%E6%83%85%E5%86%B5%EF%BC%8C%E5%9B%A0%E4%B8%BA%E5%9C%A8%E6%88%91%E7%9A%84%E6%83%85%E5%86%B5%E4%B8%8B%EF%BC%8C%E6%8E%92%E9%99%A4%E7%9A%84%E8%A1%8C%E6%98%AF%E6%97%A0%E6%95%88%E6%95%B0%E6%8D%AE%E3%80%82%E6%88%91%E5%8F%AA%E6%98%AF%E4%B8%BA%E4%BA%86%E8%B7%9F%E8%B8%AA%E7%9B%AE%E7%9A%84%E8%80%8C%E4%BF%9D%E7%95%99%E5%AE%83%E4%BB%AC%E3%80%82%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3E%3CU%3E%E6%89%80%E4%BB%A5%EF%BC%8C%E6%9C%80%E5%90%8E%E6%88%91%E7%9A%84%E6%84%BF%E6%9C%9B%E6%98%AF%EF%BC%9AJMP%20%E5%9C%A8%E4%BD%BF%E7%94%A8%E6%8E%92%E9%99%A4%E8%A1%8C%E6%97%B6%E8%83%BD%E5%90%A6%E5%AE%8C%E5%85%A8%E4%B8%80%E8%87%B4%EF%BC%9F%3C%2FU%3E%3C%2FP%3E%0A%3CP%3E%20%3C%2FP%3E%0A%3CP%3E%E4%BB%A5%E4%B8%8B%E6%98%AF%20JMP%3CFONT%20size%3D%223%22%3E%E6%94%AF%E6%8C%81%E4%BA%BA%E5%91%98%3C%2FFONT%3E%E5%8F%91%E7%BB%99%E6%88%91%E7%9A%84%E4%B8%80%E6%9D%A1%E8%AF%84%E8%AE%BA%EF%BC%9A%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E%E2%80%9CJMP%20Pro%20%E4%B8%AD%E7%9A%84%20Bootstrap%20Forest%20%E5%92%8C%E5%85%B6%E4%BB%96%E5%87%A0%E4%B8%AA%E5%B9%B3%E5%8F%B0%E5%85%B7%E6%9C%89%E4%B8%80%E9%A1%B9%E5%8A%9F%E8%83%BD%EF%BC%8C%E5%A6%82%E6%9E%9C%E6%8E%92%E9%99%A4%E6%9F%90%E4%BA%9B%E8%A1%8C%EF%BC%8C%E5%B9%B6%E4%B8%94%E6%82%A8%E6%9C%AA%E6%8C%87%E5%AE%9A%E9%AA%8C%E8%AF%81%E9%9B%86%EF%BC%8C%E5%88%99%E8%BF%99%E4%BA%9B%E8%A1%8C%E5%B0%86%E7%94%A8%E4%BD%9C%E9%AA%8C%E8%AF%81%E9%9B%86%E3%80%82%3C%2FSPAN%3E%3C%2FFONT%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E%E4%B8%BA%E4%BA%86%E5%AE%8C%E5%85%A8%E9%81%BF%E5%85%8D%E5%8C%85%E5%90%AB%E8%BF%99%E4%BA%9B%E8%A1%8C%EF%BC%8C%E6%82%A8%E5%8F%AF%E4%BB%A5%EF%BC%9A%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E1%EF%BC%89%E5%AF%B9%E6%95%B0%E6%8D%AE%E8%A1%A8%E8%BF%9B%E8%A1%8C%E5%AD%90%E9%9B%86%E5%8C%96%EF%BC%8C%E4%BD%BF%E5%85%B6%E4%B8%8D%E5%8C%85%E5%90%AB%E8%BF%99%E4%BA%9B%E8%A1%8C%EF%BC%8C%E7%84%B6%E5%90%8E%E9%87%8D%E6%96%B0%E8%BF%90%E8%A1%8C%20Bootstrap%20Forest%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E2%EF%BC%89%E4%BD%BF%E7%94%A8%E4%B8%8D%E5%90%8C%E7%9A%84%E9%AA%8C%E8%AF%81%E6%96%B9%E6%B3%95%EF%BC%88%E4%BF%9D%E7%95%99%E6%88%96%E9%AA%8C%E8%AF%81%E5%88%97%EF%BC%89%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%3CFONT%20size%3D%222%22%3E%3CSPAN%20class%3D%22cs78ab32121%22%3E%E4%B8%80%E8%88%AC%E6%9D%A5%E8%AF%B4%EF%BC%8C%E5%B0%86%E4%B8%80%E4%BA%9B%E8%A1%8C%E4%B8%93%E9%97%A8%E7%94%A8%E4%BA%8E%E9%AA%8C%E8%AF%81%E9%9B%86%E9%80%9A%E5%B8%B8%E6%98%AF%E4%B8%80%E4%B8%AA%E5%A5%BD%E4%B8%BB%E6%84%8F%E3%80%82%E8%BF%99%E5%B0%86%E4%BD%BF%E6%82%A8%E8%83%BD%E5%A4%9F%E4%BD%BF%E7%94%A8%E6%97%A9%E6%9C%9F%E5%81%9C%E6%AD%A2%E9%80%89%E9%A1%B9%EF%BC%8C%E8%BF%99%E6%9C%89%E5%8A%A9%E4%BA%8E%E9%81%BF%E5%85%8D%E8%BF%87%E5%BA%A6%E6%8B%9F%E5%90%88%E3%80%82%3C%2FSPAN%3E%3C%2FFONT%3E%3C%2FP%3E%0A%3CP%20class%3D%22cs95e872d0%22%3E%20%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-225496%22%20slang%3D%22en-US%22%20mode%3D%22UPDATE%22%3E%3CLINGO-LABEL%3E%E9%A2%84%E6%B5%8B%E6%A8%A1%E5%9E%8B%E5%92%8C%E6%9C%BA%E5%99%A8%E5%AD%A6%E4%B9%A0%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-245755%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%E5%9B%9E%E5%A4%8D%EF%BC%9A%E4%B8%80%E8%87%B4%E5%A4%84%E7%90%86%E6%8E%92%E9%99%A4%E7%9A%84%E8%A1%8C-%E7%8A%B6%E6%80%81%E6%9B%B4%E6%94%B9%E4%B8%BA%EF%BC%9A%E5%B7%B2%E4%BA%A4%E4%BB%98%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-245755%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CP%3E%E4%BB%8EJMP%2015%E5%BC%80%E5%A7%8B%EF%BC%8C%E9%99%A4%E9%9D%9E%E6%8F%90%E4%BA%A4JSL%EF%BC%8C%E5%90%A6%E5%88%99%E6%8E%92%E9%99%A4%E7%9A%84%E8%A1%8C%E5%B0%86%E4%B8%8D%E7%94%A8%E4%BA%8E%E9%AA%8C%E8%AF%81%EF%BC%9A%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CPRE%3EUse%20Excluded%20Rows%20for%20Validation(1)%3C%2FPRE%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E
Choose Language Hide Translation Bar
0 Kudos

Consistent handling of excluded rows

Hi,

 

I had a conversation with JMP support since I assumed a bug in JMP. However, I learned the following:

- If one marks certain rows as "excluded" (no matter if chosen visible or nor) they will be removed from many computations (e.g. doing a histogram does not take excluded rows into account)

- If one marks certain rows as "excluded" (no matter if chosen visible or nor) they will be included as a validation set for platforms like boosted tree or bootstrap forest.

Apparently this is intended behavior. Personally, it confused me and fortunately I got in contact with support to learn about it before I published the results, since in my case the excluded rows are invalid data. I just keep those for tracking purposes.

 

So, finally my wish: could JMP be fully consistent in the use of excluded rows?

 

Here's a quote that JMP support sent me:

"The Bootstrap Forest and several other platforms in JMP Pro have a feature that if some rows are excluded, and you do not otherwise specify a Validation set, those rows are used as the Validation set. To avoid those rows from being included at all, you could:

1) Subset the data table so it doesn't include those rows, then re-run the Bootstrap Forest

2) Use a different Validation method (Holdback or Validation Column)

In general, it is often a good idea to devote some rows to a Validation set. This would give you the ability to use the Early Stopping option, which can help avoid overfitting."

 

1 Comment
Jeff_Perkinson
Community Manager
Status changed to: Delivered

Starting in JMP 15 excluded rows are not used for Validation unless you submit the JSL:

 

Use Excluded Rows for Validation(1)