cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
The Discovery Summit 2025 Call for Content is open! Submit an abstract today to present at our premier analytics conference.
Choose Language Hide Translation Bar
View Original Published Thread

Problems with Reproducibility

onurseref
Level I

I teach using JMP and I became aware of some reproducibility problems in the following cases:

 

1) My students who use different operating systems like windows and MacOS get different results from models that require randomization like NN even if they use the same random seed like 123. This problem is frustrating because assignments that use a random seed for reproducibility reasons are supposed to have a unique true solution for comparison, and different results confuse students.

 

2) Some methods like SVM has a conventional tuning design to find a good combination of parameters; however, no random seed option is offered in the tuning design interface, which leads to different results that, again, confuse students.

I'm not sure if these are known issues. Nevertheless, I would appreciate any feedback that can address them.

0 REPLIES 0