Recording Experimenters' Club Q2 2026_Beyond One Best Model: What a DSD Can Really Tell You

maria_astals — Thu, 30 Apr 2026 07:02:51 GMT

Video 1: Challenge - Beyond One Best Model: What a DSD Can Really Tell You

The Q2 session of the Experimenter’s Club featured a lively discussion on George Box’s famous reminder that "all models are wrong, but some are useful."

It began with a user questioning whether unexpectedly strong interaction and quadratic effects in a 6-factor Definitive Screening Design (DSD) should be trusted. What followed was a thoughtful exchange showing that the real issue is not whether one model is “correct,” but how to interpret a design space in which many plausible models coexist.

(view in My Videos)

Community Question: https://community.jmp.com/t5/Discussions/quot-Surprising-quot-results-in-an-DSD-Design/td-p/941518

LinkedIn post from Victor: https://www.linkedin.com/posts/victorguiller_experimentersclub-designofexperiments-share-7453440558682894336-j7Ki?utm_source=share&utm_medium=member_desktop&rcm=ACoAAAg2XG8BduAUlMeluDXcuMFV-P_Hxv1KA0k

Video 2: Discussion

The conversation highlighted that in a DSD with a limited number of runs, it is impossible to estimate every main, interaction, and quadratic effect simultaneously without structural tradeoffs. As a result, partial aliasing, multicollinearity, and model multiplicity are natural features of the problem rather than signs of failure.

The discussion emphasized that different estimation methods and selection criteria, such as R², adjusted R², AICc, BIC, and RMSE, can lead to different but still defensible models.

(view in My Videos)

A key takeaway is that experimenters should not focus only on finding a single best-fitting model. Instead, they should compare multiple strong candidates, look for effects that appear consistently across good models, apply effect hierarchy and domain knowledge, and consider augmentation when confirmation is needed.

In that sense, the design process becomes less about reacting to surprising results and more about disciplined model judgment in real-world experimental work.

topic Recording Experimenters' Club Q2 2026_Beyond One Best Model: What a DSD Can Really Tell You in Design of Experiments Club Discussions

Recording Experimenters' Club Q2 2026_Beyond One Best Model: What a DSD Can Really Tell You