cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 

Discussions

Solve problems, and share tips and tricks with other JMP users.
%3CLINGO-SUB%20id%3D%22lingo-sub-189094%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3EJMP%20%2F%20JMP%20PRO%E3%82%92%E4%BD%BF%E7%94%A8%E3%81%97%E3%81%9F%E6%99%82%E7%B3%BB%E5%88%97%E3%81%AEk%E5%88%86%E5%89%B2%E7%9B%B8%E4%BA%92%E6%A4%9C%E8%A8%BC%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-189094%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CDIV%3E%E3%83%96%E3%83%BC%E3%83%88%E3%82%B9%E3%83%88%E3%83%A9%E3%83%83%E3%83%97%E3%81%BE%E3%81%9F%E3%81%AF%E3%83%96%E3%83%BC%E3%82%B9%E3%83%88%20%E3%83%84%E3%83%AA%E3%83%BC%E3%82%92%E4%BD%BF%E7%94%A8%E3%81%97%E3%81%9F%E3%81%84%E3%81%AE%E3%81%A7%E3%81%99%E3%81%8C%E3%80%81%E3%83%91%E3%83%BC%E3%83%86%E3%82%A3%E3%82%B7%E3%83%A7%E3%83%B3%20%E3%83%84%E3%83%AA%E3%83%BC%E3%81%BE%E3%81%9F%E3%81%AF%E3%83%8B%E3%83%A5%E3%83%BC%E3%83%A9%E3%83%AB%20%E3%83%8D%E3%83%83%E3%83%88%E3%81%A7%E4%BD%BF%E7%94%A8%E3%81%99%E3%82%8B%E3%81%9F%E3%82%81%E3%80%81k%20%E5%88%86%E5%89%B2%E6%B3%95%E3%82%92%E4%BD%BF%E7%94%A8%E3%81%97%E3%81%BE%E3%81%99%E3%80%82%20%E3%81%9F%E3%81%A0%E3%81%97%E3%80%81%E4%BF%AE%E6%AD%A3%E6%A4%9C%E8%A8%BC%E5%88%97%E3%82%92%E8%BF%BD%E5%8A%A0%E3%81%99%E3%82%8B%E3%82%AA%E3%83%97%E3%82%B7%E3%83%A7%E3%83%B3%E3%81%97%E3%81%8B%E8%A1%A8%E7%A4%BA%E3%81%95%E3%82%8C%E3%81%BE%E3%81%9B%E3%82%93%E3%80%82%3C%2FDIV%3E%3CDIV%3E%26nbsp%3B%3C%2FDIV%3E%3CDIV%3E%E7%A7%81%E3%81%AF%E6%99%82%E7%B3%BB%E5%88%97%E3%82%92%E6%89%B1%E3%81%A3%E3%81%A6%E3%81%84%E3%82%8B%E3%81%9F%E3%82%81%E3%80%81%E3%83%A9%E3%83%B3%E3%83%80%E3%83%A0%E3%81%AA%E3%82%B5%E3%83%B3%E3%83%97%E3%83%AB%E3%82%92%E4%BD%BF%E7%94%A8%E3%81%97%E3%81%A6%E3%83%A2%E3%83%87%E3%83%AB%E3%82%92%E9%81%A9%E5%90%88%E3%81%95%E3%81%9B%E3%82%8B%E3%81%93%E3%81%A8%E3%81%8C%E3%81%A7%E3%81%8D%E3%81%BE%E3%81%9B%E3%82%93%E3%80%82%3C%2FDIV%3E%3CDIV%3E%26nbsp%3B%3C%2FDIV%3E%3CDIV%3E%E3%81%93%E3%82%8C%E3%81%AB%E5%8A%A0%E3%81%88%E3%81%A6%E3%80%81JMP%20%E3%81%AB%E5%AE%9F%E8%A3%85%E3%81%95%E3%82%8C%E3%81%A6%E3%81%84%E3%82%8B%20k-fold%20%E3%81%AB%E3%81%AF%E5%B8%B8%E3%81%AB%E3%83%A9%E3%83%B3%E3%83%80%E3%83%A0%E3%82%B5%E3%83%B3%E3%83%97%E3%83%AB%E3%81%A8%E8%A8%98%E8%BC%89%E3%81%95%E3%82%8C%E3%81%A6%E3%81%84%E3%82%8B%E3%81%9F%E3%82%81%E3%80%81%E7%96%91%E3%82%8F%E3%81%97%E3%81%84%E3%81%A7%E3%81%99%E3%80%82%3C%2FDIV%3E%3CDIV%3E%26nbsp%3B%3C%2FDIV%3E%3CDIV%3E%3CDIV%3E%3CIMG%20src%3D%22https%3A%2F%2Fmail.google.com%2Fmail%2Fu%2F0%3Fui%3D2%26amp%3Bik%3D64bdcd3c2a%26amp%3Battid%3D0.1%26amp%3Bpermmsgid%3Dmsg-a%3Ar-4161597882810104327%26amp%3Bth%3D169b54695a8f639c%26amp%3Bview%3Dfimg%26amp%3Bsz%3Ds0-l75-ft%26amp%3Battbid%3DANGjdJ9UF-wR-OkiRbftZyFu79E8El2cb2Ew_8Kyjz6L1hL5QY78qw_heF-DDpNvhU3EeTAuho3_8vh0LL5KXrCQQjxac7Xt0g8HXcQl7OJQNjwMK-uRk5oYp02jv-o%26amp%3Bdisp%3Demb%26amp%3Brealattid%3Dii_jtog53fe0%22%20border%3D%220%22%20alt%3D%22%E7%94%BB%E5%83%8F.png%22%20width%3D%22452%22%20height%3D%22387%22%20%2F%3E%3C%2FDIV%3E%3C%2FDIV%3E%3CDIV%3E%26nbsp%3B%3C%2FDIV%3E%3CDIV%3E%E7%A7%81%E3%81%AF%EF%BC%88%E5%B0%91%E3%81%AA%E3%81%8F%E3%81%A8%E3%82%82%EF%BC%89%E6%AC%A1%E3%81%AE%E3%82%88%E3%81%86%E3%81%AA%E3%82%B7%E3%83%BC%E3%82%B1%E3%83%B3%E3%82%B9%E3%81%AE%E5%BE%8C%E3%81%A7%E3%81%99%E3%80%82%3C%2FDIV%3E%3CDIV%3E%26nbsp%3B%3C%2FDIV%3E%3CDIV%3E%3CDIV%3E%3CIMG%20src%3D%22https%3A%2F%2Fmail.google.com%2Fmail%2Fu%2F0%3Fui%3D2%26amp%3Bik%3D64bdcd3c2a%26amp%3Battid%3D0.2%26amp%3Bpermmsgid%3Dmsg-a%3Ar-4161597882810104327%26amp%3Bth%3D169b54695a8f639c%26amp%3Bview%3Dfimg%26amp%3Bsz%3Ds0-l75-ft%26amp%3Battbid%3DANGjdJ_PZqtSAfsrJSP7ef3GjvIDzPy1VRnJa2H8SiD8EPixwGtbPm8lwu3lodVumOBzdH9qSVpZbuOrKVxoNPioAo6nyHVcvr73DZv5KNs-KIPnno2pomq4-4ZAyxE%26amp%3Bdisp%3Demb%26amp%3Brealattid%3Dii_jtog8exd1%22%20border%3D%220%22%20alt%3D%22%E7%94%BB%E5%83%8F.png%22%20width%3D%22452%22%20height%3D%22226%22%20%2F%3E%3C%2FDIV%3E%3C%2FDIV%3E%3CDIV%3E%E3%81%9D%E3%81%97%E3%81%A6%E3%80%81JMP%20%E3%81%AF%E6%AC%A1%E3%81%AE%E3%82%88%E3%81%86%E3%81%AA%E3%81%93%E3%81%A8%E3%82%92%E8%A1%8C%E3%81%86%E3%81%A8%E6%80%9D%E3%81%84%E3%81%BE%E3%81%99%20(%E7%A2%BA%E8%AA%8D%E3%81%97%E3%81%A6%E3%81%8F%E3%81%A0%E3%81%95%E3%81%84)%E3%80%82%3C%2FDIV%3E%3CDIV%3E%26nbsp%3B%3C%2FDIV%3E%3CDIV%3E%3CDIV%3E%3CIMG%20src%3D%22https%3A%2F%2Fmail.google.com%2Fmail%2Fu%2F0%3Fui%3D2%26amp%3Bik%3D64bdcd3c2a%26amp%3Battid%3D0.3%26amp%3Bpermmsgid%3Dmsg-a%3Ar-4161597882810104327%26amp%3Bth%3D169b54695a8f639c%26amp%3Bview%3Dfimg%26amp%3Bsz%3Ds0-l75-ft%26amp%3Battbid%3DANGjdJ_t61Eur2dLTL5CWsAhybt5XZp95LxZoxYXP8JMD8trUa_lvlMJ0mkocUgd7Df-N6BWSvb30bzKD0rSYSaUTB_AeV9bQID1LHv0LzPbbHj33C99X-0CeIX3GOo%26amp%3Bdisp%3Demb%26amp%3Brealattid%3Dii_jtogao5f2%22%20border%3D%220%22%20alt%3D%22%E7%94%BB%E5%83%8F.png%22%20width%3D%22452%22%20height%3D%22226%22%20%2F%3E%3C%2FDIV%3E%3C%2FDIV%3E%3CDIV%3E%26nbsp%3B%3C%2FDIV%3E%3CDIV%3E%E3%81%93%E3%81%93%E3%81%AB%E3%81%99%E3%81%B9%E3%81%A6%E3%81%AE%E3%82%AA%E3%83%97%E3%82%B7%E3%83%A7%E3%83%B3%E3%81%8C%E3%81%82%E3%82%8A%E3%81%BE%E3%81%99%E3%81%8C%E3%80%81%E7%A7%81%E3%81%AE%E5%A0%B4%E5%90%88%E3%81%AB%E6%9C%80%E9%81%A9%E3%81%AA%E3%81%AE%E3%81%AF%20TimeSplit%20%E3%81%A7%E3%81%99%E3%80%82%3C%2FDIV%3E%3CDIV%3E%3CA%20href%3D%22https%3A%2F%2Fscikit-learn.org%2Fstable%2Fauto_examples%2Fmodel_selection%2Fplot_cv_indices.html%23sphx-glr-auto-examples-model-selection-plot-cv-indices-py%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3Ehttps%3A%2F%2Fscikit-learn.org%2Fstable%2Fauto_examples%2Fmodel_selection%2Fplot_cv_indices.html%23sphx-glr-auto-examples-model-selection-plot-cv-indices-py%3C%2FA%3E%3C%2FDIV%3E%3CDIV%3E%3CDIV%3E%26nbsp%3B%3C%2FDIV%3E%3CDIV%3E%E4%BD%95%E3%81%8B%E3%82%A2%E3%82%A4%E3%83%87%E3%82%A2%E3%82%84%E5%9B%9E%E9%81%BF%E7%AD%96%E3%81%AF%E3%81%82%E3%82%8A%E3%81%BE%E3%81%99%E3%81%8B%3F%3C%2FDIV%3E%3CDIV%3E%26nbsp%3B%3C%2FDIV%3E%3C%2FDIV%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-190065%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3ERe%3A%20JMP%20%2F%20JMP%20PRO%20%E3%82%92%E4%BD%BF%E7%94%A8%E3%81%97%E3%81%9F%E6%99%82%E7%B3%BB%E5%88%97%E3%81%A7%E3%81%AE%20k%20%E5%88%86%E5%89%B2%E7%9B%B8%E4%BA%92%E6%A4%9C%E8%A8%BC%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-190065%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CP%3E%E3%83%8B%E3%83%A5%E3%83%BC%E3%83%A9%E3%83%AB%20%E3%83%8D%E3%83%83%E3%83%88%E3%83%AF%E3%83%BC%E3%82%AF%E3%81%A8%E6%A4%9C%E8%A8%BC%E5%88%97%E3%82%92%E4%BD%BF%E7%94%A8%E3%81%99%E3%82%8B%E5%A0%B4%E5%90%88%E3%80%81%E7%B5%90%E6%9E%9C%E3%81%AF%E5%8D%98%E7%B4%94%E3%81%AA%E5%A4%96%E6%8C%BF%E3%81%AB%E3%81%AA%E3%82%8A%E3%81%BE%E3%81%99%E3%80%82%20%E3%81%93%E3%81%AE%E3%82%A4%E3%83%B3%E3%82%BF%E3%83%BC%E3%83%95%E3%82%A7%E3%82%A4%E3%82%B9%E3%81%A7%E3%82%82%E3%83%86%E3%82%B9%E3%83%88%E8%A1%8C%E3%81%AF%E4%BD%BF%E7%94%A8%E3%81%95%E3%82%8C%E3%81%BE%E3%81%9B%E3%82%93%E3%80%82%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%E3%83%84%E3%83%AA%E3%83%BC%E3%81%BE%E3%81%9F%E3%81%AF%20NN%20%E3%81%AE%E3%81%84%E3%81%9A%E3%82%8C%E3%81%8B%E3%81%AB%E9%81%A9%E5%88%87%E3%81%AA%20k-fold%20%E3%82%92%E5%AE%9F%E8%A3%85%E3%81%99%E3%82%8B%E6%96%B9%E6%B3%95%E3%81%AB%E3%81%A4%E3%81%84%E3%81%A6%E3%81%AE%E3%82%A2%E3%82%A4%E3%83%87%E3%82%A2%E3%81%AF%E3%81%82%E3%82%8A%E3%81%BE%E3%81%99%E3%81%8B%3F%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22JMP%20NN.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22JMP%20NN.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22JMP%20NN.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.jmp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F16683i74535C4C496C2FCA%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22JMP%20NN.png%22%20alt%3D%22JMP%20NN.png%22%20%2F%3E%3C%2Fspan%3E%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-190062%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3ERe%3A%20JMP%20%2F%20JMP%20PRO%20%E3%82%92%E4%BD%BF%E7%94%A8%E3%81%97%E3%81%9F%E6%99%82%E7%B3%BB%E5%88%97%E3%81%A7%E3%81%AE%20k%20%E5%88%86%E5%89%B2%E7%9B%B8%E4%BA%92%E6%A4%9C%E8%A8%BC%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-190062%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CP%3E%E3%81%BE%E3%81%9F%E3%80%81cutpointvalidation%20%E3%83%A1%E3%82%BD%E3%83%83%E3%83%89%E3%82%92%E3%83%84%E3%83%AA%E3%83%BC%E3%81%AB%E9%81%A9%E5%90%88%E3%81%95%E3%81%9B%E3%82%8B%E3%81%9F%E3%82%81%E3%81%AE%E5%88%97%E3%81%A8%E3%81%97%E3%81%A6%E4%BD%BF%E7%94%A8%E3%81%99%E3%82%8B%E5%A0%B4%E5%90%88%20(JMP%20%E3%81%AE%E6%99%82%E7%B3%BB%E5%88%97%E3%81%AB%E6%8E%A8%E5%A5%A8)%3A%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22cut%20point%20tree%20jmp%2014.png%22%20style%3D%22width%3A%20448px%3B%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22cut%20point%20tree%20jmp%2014.png%22%20style%3D%22width%3A%20448px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22cut%20point%20tree%20jmp%2014.png%22%20style%3D%22width%3A%20448px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.jmp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F16681i76207C6E44D12BF5%2Fimage-dimensions%2F448x279%3Fv%3Dv2%22%20width%3D%22448%22%20height%3D%22279%22%20role%3D%22button%22%20title%3D%22cut%20point%20tree%20jmp%2014.png%22%20alt%3D%22cut%20point%20tree%20jmp%2014.png%22%20%2F%3E%3C%2Fspan%3E%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-SUB%20id%3D%22lingo-sub-190060%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3ERe%3A%20JMP%20%2F%20JMP%20PRO%20%E3%82%92%E4%BD%BF%E7%94%A8%E3%81%97%E3%81%9F%E6%99%82%E7%B3%BB%E5%88%97%E3%81%A7%E3%81%AE%20k%20%E5%88%86%E5%89%B2%E7%9B%B8%E4%BA%92%E6%A4%9C%E8%A8%BC%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-190060%22%20slang%3D%22en-US%22%20mode%3D%22NONE%22%3E%3CP%3E%E7%A2%BA%E8%AA%8D%E6%B8%88%E3%81%BF%3A%20JMP%2014%20%E3%81%A7%E3%81%AF%E3%80%81K%20%E5%80%8D%E3%81%AF%E5%AE%9F%E9%9A%9B%E3%81%AB%E3%81%AF%20k%20%E5%9B%9E%E8%A1%8C%E3%82%8F%E3%82%8C%E3%82%8B%E3%83%A9%E3%83%B3%E3%83%80%E3%83%A0%20%E3%82%B5%E3%83%B3%E3%83%97%E3%83%AA%E3%83%B3%E3%82%B0%E3%81%A7%E3%81%99%E3%80%82%3C%2FP%3E%3CP%3E%26nbsp%3B%3C%2FP%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22k%20fold%20Neural%20Network%20JMP.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22k%20fold%20Neural%20Network%20JMP.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3Cspan%20class%3D%22lia-inline-image-display-wrapper%22%20image-alt%3D%22k%20fold%20Neural%20Network%20JMP.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3Cimg%20src%3D%22https%3A%2F%2Fcommunity.jmp.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F16680i0E1D0CF24B9E034D%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22k%20fold%20Neural%20Network%20JMP.png%22%20alt%3D%22k%20fold%20Neural%20Network%20JMP.png%22%20%2F%3E%3C%2Fspan%3E%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FP%3E%3C%2FLINGO-BODY%3E
Choose Language Hide Translation Bar
FN
FN
Level VI

k-fold cross validation in time series with JMP / JMP PRO

I want to use Bootstrap or Boosted Trees but with a k-fold method as I use it in the partition trees or neural nets. However I only see the option of adding a fix validation column.
 
Since I am working with time series, random samples cannot be used well to fit my models. 
 
In addition to this, I am suspicious with the k-fold implemented in JMP as it always says random sample.
 
image.png
 
I am after a sequence like this one (at least):
 
image.png
And I think JMP does something like this (please confirm):
 
image.png
 
Here are all the options, the best for my case would be TimeSplit.
 
Any ideas or workarounds?
 
3 REPLIES 3
FN
FN
Level VI

Re: k-fold cross validation in time series with JMP / JMP PRO

Confirmed: In JMP 14, K-fold it is actually a random sampling done k times. 

 

k fold Neural Network JMP.png

FN
FN
Level VI

Re: k-fold cross validation in time series with JMP / JMP PRO

And if the cutpointvalidation method is used as a column to fit trees (recommended for time series in JMP):

 

cut point tree jmp 14.png

 

FN
FN
Level VI

Re: k-fold cross validation in time series with JMP / JMP PRO

When using Neural Networks and the validation column, the results are a simple extrapolation. Test rows are not used in this interface either.

 

Ideas on how to implement a proper k-fold for either trees or NN?JMP NN.png

 

 

 

Recommended Articles