topic Re: Bootstrapping takes a long time in Discussions

Bootstrapping takes a long time

Tyler_Burda — Sat, 10 Jun 2023 20:49:23 GMT

Hello,

I am performing a bootstrap on some data created using the mixture distribution function as part of the life distribution to calculate reliability. I am using the bootstrap data to develop confidence intervals for the mixture distribution parameters. The 5 parameters estimated are sigma 1&2, mu 1&2, and portion which is what I am creating the bootstrap for. I am not designating a random seed and left as a '.', I am using fractional weights though with a generated sample size of 2500 as the standard input. The question I have is should this bootstrap normally take 1.5 hours or so? It seems to be pretty long and I was discussing with a coworker that this doesn't seem right and to get my computer checked out as the processing speed may be low. But my computer is fairly new, I have a Dell Precision 7560 with i7 intel processor 2.50GHz and 32GB of RAM, so I am curious if the long time for bootstrapping is typical or if there is something else with JMP I should look into?

Thanks for the help!

Re: Bootstrapping takes a long time

Georg — Sat, 05 Mar 2022 11:37:55 GMT

Cannot judge this, but probably we need a benchmark script to compare,

see code encluded. The analysis needs 79 s on my computer (JMP 16.1 Pro on Win10 on Dell precision 3551 Intel core i7 2.7 MHz 32GB, probably comparable to yours).

Names Default To Here( 1 );

starttime = tick seconds();
dt = New Table( "Random",
	add rows( 1000000 ),
	New Column( "X", formula( Row() ) ),
	New Column( "Y", formula( :X + Random Normal( 0, 3 ) ) )
);

obj = Bivariate( Y( :Y ), X( :X ) );
obj << Fit Line;
(obj << Report)[Number Col Box( 1 )] << Bootstrap(
	100,
	Fractional Weights( 1 ),
	Split Selected Column( 1 )
);
endtime= tick seconds();
print(eval insert("Analysis took ^round(endtime - starttime)^ seconds"))

Re: Bootstrapping takes a long time

Craige_Hales — Mon, 07 Mar 2022 00:00:38 GMT

166 seconds on older 4 cpu machine. You have nice hardware!

Re: Bootstrapping takes a long time

lala — Mon, 07 Mar 2022 02:45:24 GMT

JMP Pro 14、core i5

Re: Bootstrapping takes a long time

ian_jmp — Mon, 07 Mar 2022 11:49:09 GMT

Can't resist a benchmark :). 45 seconds on my MacBook Pro (JMP 16.2):

Re: Bootstrapping takes a long time

dale_lehman — Mon, 07 Mar 2022 12:49:07 GMT

That makes me feel good. My machine is at least 12 years old (i7, 3.4GHz) and it took 142 seconds. I keep thinking I need to upgrade my machine, but it seems wasteful and unnecessary. These benchmark results help - yes, I can do better, but I'm not completely out of line!

Re: Bootstrapping takes a long time

Mark_Bailey — Mon, 07 Mar 2022 13:03:00 GMT

Me neither: "Analysis took 21 seconds"

macOS Monterey on MacBook Pro M1 Max with JMP Pro 16.2

Re: Bootstrapping takes a long time

PatrickGiuliano — Mon, 07 Mar 2022 21:45:46 GMT

194 seconds

Windows 10

11th Gen Intel(R) Core(TM) i7-1185G7 @ 3.00GHz 3.00 GHz

16.0 GB (15.7 GB usable)

JMP Pro 16

With many applications running concurrently in RAM. :)

Re: Bootstrapping takes a long time

peng_liu — Tue, 08 Mar 2022 19:03:57 GMT

Mixture distribution fitting is computationally intensive, and the success of fitting heavily depends on the quality of data assuming the model is the right choice. Try the sample data "Mixture Demo" under reliability sample data folder, and see how slow it can be comparing to other modeling types (e.g. least square). That sample data was simulated and considered very good.

Re: Bootstrapping takes a long time

pmroz — Wed, 09 Mar 2022 19:24:28 GMT

Took 80 seconds with JMP 17 Pro EA on my Lenovo Windows 10 machine. 11th Gen Intel(R) Core(TM) i5-1145G7 @ 2.60GHz 2.61 GHz, 16GB RAM

Re: Bootstrapping takes a long time

mikedriscoll — Wed, 09 Mar 2022 21:57:50 GMT

When I hear users describing excessive time to generate reports, I usually suggest to go into File -> preferences -> windows specific, and uncheck 'enable hardware accelerated graphics.' I have no idea if that will help in your case, because I think when users have this issue it applies to many or all platforms, but it is an easy thing to check. Sounds like you'll know in a few minutes (or a few hours).

Here's a note on it:

https://www.jmp.com/support/notes/67/990.html

Re: Bootstrapping takes a long time

Tyler_Burda — Tue, 15 Mar 2022 14:56:29 GMT

Hi @Georg,

Thanks for the benchmark! I ran it and it took me 77 seconds, so I think the issue is more in regards to the computationally intensive method of the bootstrap for estimating the statistical parameters from the mixture distribution data, as @peng_liu pointed out in a later response. I attached an example of the parameters I perform the bootstrap on which takes the 1.5 hours.

Re: Bootstrapping takes a long time

Georg — Wed, 16 Mar 2022 06:05:32 GMT

I know that this can make trouble, we had several laptops, where this option checked lead to unresponsive GUI (on windows machines, using JMP16 ...). Unchecking this option made the problem gone. So I resume this is connected to the graphical display (as the option says) and not to the underlying calculation, that here needs the time, and it's complexity is the "problem".

Re: Bootstrapping takes a long time

mikedriscoll — Wed, 16 Mar 2022 15:10:03 GMT

Hi Georg,

I agree with you. I figured I would mention it just in case it was related but at this point I'd say it definitely is not. The original poster responded in this thread yesterday (but for some reason it is showing up in the middle of page 1) that their run of benchmark took 77 seconds, so that is in the range everyone else's results.

Re: Bootstrapping takes a long time

Tyler_Burda — Thu, 17 Mar 2022 14:31:59 GMT

Yeah I tried unchecking 'enable hardware accelerated graphics' and the bootstrap still takes the 1.5 hours or so. Thanks for the suggestion though!