topic Re: Creating a validation column in JMP PRO in Discussions

Creating a validation column in JMP PRO

agneshb — Thu, 16 Oct 2014 13:56:31 GMT

is there a quick way or addins to create the validation column when using JMP PRO (and not to have to go through the steps in new colunm>missing data>random...).

I'm aware of the save validation in the neural platform, but it only creates training and validation category (I like to also have a test category).

Thanks!

Agnès

Re: Creating a validation column in JMP PRO

Mark_Bailey — Thu, 16 Oct 2014 16:06:26 GMT

When you create the new column for the validation status, you can use the Initialize Data option near the bottom of the dialog to select Random > Random Indicator. From here, I would then enter a large portion for 0 and 1-portion for 1. The portion is up to you, perhaps 0.25-0.5.

Re: Creating a validation column in JMP PRO

agneshb — Thu, 16 Oct 2014 16:17:14 GMT

Thanks Mark and it is the way I'm doing now, usually using 0.6 for the training, 0.2 for the validation and 0.2 for the test, but I have to recreate the column each time I create a new subset of data and I was wondering if there was a simpler way to generate the column or a script that can be saved.

Re: Creating a validation column in JMP PRO

jules — Tue, 18 Oct 2016 21:53:41 GMT

Hi AgnesHB,

Maybe this will help? I used Sequence() to count from 1 to 5 (with step size of 1, and repeating each value 1 time), and placed the sequence in a match function to recode 1, 2, and 3 as 0 (for training), 4 as 1 (for validation) and 5 as 2 (for test), which will fit your .6, .2, .2 setup.

JSL: Match(Sequence(1, 5, 1, 1), 1, 0, 2, 0, 3, 0, 4, 1, 5, 2)

I hope this helps!

Julian

Re: Creating a validation column in JMP PRO

jules — Tue, 21 Oct 2014 06:49:02 GMT

Alternatively, you could use a random integer function rather than sequence, but using sequence will ensure proportions more close to what you define (since a sequence is predictable and a random integer, well, isn't). But, the above could be seriously problematic if, for some reason, there is something systematically biased across the sequence (like every 5th observation being different in some way due to the measurement system, which would mean ALL your "test" data would be of that type). Probably unlikely, but not great. A quick random shuffle of rows would solve that problem.

Julian

Re: Creating a validation column in JMP PRO

yvesa_roy — Tue, 18 Oct 2016 21:55:14 GMT

Hi,

There should be no distinguishible pattern in the selection criterion. One of the simplest formulas uses the RandomCategory function of JMP, like this :

(Sorry for the decimal commas but I work in France). You will have to insert a new line in the function definition in the dialog box as, by default, the function proposes only two.

Yves

Re: Creating a validation column in JMP PRO

jules — Sat, 25 Oct 2014 08:18:15 GMT

I wasn't aware of Random Category() until now; that's a much more elegant solution!

Julian

Re: Creating a validation column in JMP PRO

gianpaolo — Mon, 16 Dec 2019 14:49:28 GMT

Another Alternative:

Names Default To Here( 1 );
dt = Open( "$SAMPLE_DATA/Big Class.jmp" );
dt << Make Validation Column(
	Training Set( 0.75 ),
	Validation Set( 0.25 ),
	Validation Column Type( Formula ),
	Go
);

ciao

Gianpaolo