Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.

Showing results for

- JMP User Community
- :
- Discussions
- :
- Re: more replications or more runs?

- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Jun 26, 2013 7:06 PM
(6875 views)

Hi,

I am designing an experiment using custom design in JMP. Number of variables and their levels is high, so I cannot do a full factorial design, but I could have more runs than the minimum that JMP gives me. My question is that which one is better; to have more replications or to have more runs?

Thanks

1 ACCEPTED SOLUTION

Accepted Solutions

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

They look very comparable. When I ran the algorithm and giving it 1000 starts under the red triangle my results were lightly different.

I wouldn't lose sleep over either choice.

How about a compromise with 2 replicates and 18 runs total? I have attached all three scenarios with the same simulated response model for you to see. Just run the Fit model scripts.

As you can see all approaches are comparable.

12 REPLIES 12

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: more replications or more runs?

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: more replications or more runs?

Thanks for your answer.

Let me clarify my question. My variables are as following:

I have the possibility of having 18 runs. I could set user specified to 18 or I could change the "Number of Replicate Runs" to 4 which result in 18 runs. Here are the result of both approach:

Specifying 18 in "user specified" field:

change the "Number of Replicate Runs" to 4:

Could you please let me know how to decide based on these results.

Thanks!

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

They look very comparable. When I ran the algorithm and giving it 1000 starts under the red triangle my results were lightly different.

I wouldn't lose sleep over either choice.

How about a compromise with 2 replicates and 18 runs total? I have attached all three scenarios with the same simulated response model for you to see. Just run the Fit model scripts.

As you can see all approaches are comparable.

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: more replications or more runs?

Thanks!

Is it possible for you to give me an example that one approach is preferable to the other one?

Highlighted
##

Not really. Of the three I prefer the compromise with 2 replicates and 18 runs however quite honestly I'm more concerned that you have not included two-way interactions in the experiment.

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: more replications or more runs?

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: more replications or more runs?

Ya, I did not include two-way interactions since it increases the number of runs.

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: more replications or more runs?

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: more replications or more runs?

My experiment is actually designing intersections in driving simulator. each run setting will be an intersection, and each variable is associated with a condition of the intersection (for example variable "pavement condition" with two levels of "wet" and "dry". It is good to have two-way interactions, but as we hire drivers, more number of runs would be expensive.

No, none of my factors could be continuous.

- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Get Direct Link
- Email to a Friend
- Report Inappropriate Content

Re: more replications or more runs?