topic Re: Subtraction in Column Formula Slow in Discussions

Subtraction in Column Formula Slow

Ifrit109 — Wed, 04 Oct 2023 00:28:46 GMT

Hello!

If I use analyze>tabulate>mean, then jmp 14 can take my 3 million rows and get a summary in about 15 seconds.

If I try to subtract column A from column B using a column formula, it takes 3+ hours.

How can I do a workaround to increase calculation speed? some sort of JSL?

I could just pull it into python but jmp should be able to handle subtraction!

Thanks for your help!

Re: Subtraction in Column Formula Slow

txnelson — Wed, 04 Oct 2023 02:47:04 GMT

Running Windows 11 and JMP 17.2, I created a data table with 2 columns of 3,000,000 rows and then added a new column with the formula

:p - :a

and the calculation of the formula row is virtually instantaneous.

Can you provide more specifics of your issue that might provide some insights?

Re: Subtraction in Column Formula Slow

dale_lehman — Wed, 04 Oct 2023 12:48:26 GMT

I am also running Windows 11 and JMP 17.2 and I used a data file with 6 million rows and both tabulate and the formula column calculate almost instantly (1 second). I suspect it is your hardware - on my older machines, things used to take much longer. 15 seconds sounds too long for the tabulate. But I don't know if it is hardware, JMP 14 (which I no longer have to test), or a combination of the two.

Re: Subtraction in Column Formula Slow

txnelson — Wed, 04 Oct 2023 13:51:03 GMT

I ran the same test on JMP 14 and while it was slightly slower, it did the subtraction in less than a second

Re: Subtraction in Column Formula Slow

Craige_Hales — Wed, 04 Oct 2023 14:03:41 GMT

Are there platforms (distribution, etc) open or subsets linked to the table while the formula is running? Possibly the platforms are updating as the formula progresses.

If you are scripting, dt<<runformulas will run in the foreground (faster).

Re: Subtraction in Column Formula Slow

Ifrit109 — Wed, 04 Oct 2023 21:11:04 GMT

Thanks Craig and everyone else for your input.

I did have a linked table open. Closed it and the math finished instantly, as expected!