I teach using JMP and I became aware of some reproducibility problems in the following cases:
1) My students who use different operating systems like windows and MacOS get different results from models that require randomization like NN even if they use the same random seed like 123. This problem is frustrating because assignments that use a random seed for reproducibility reasons are supposed to have a unique true solution for comparison, and different results confuse students.
2) Some methods like SVM has a conventional tuning design to find a good combination of parameters; however, no random seed option is offered in the tuning design interface, which leads to different results that, again, confuse students.
I'm not sure if these are known issues. Nevertheless, I would appreciate any feedback that can address them.