Authors
Caleb King (1), Ryan Lekivetz (1), and Joseph Morgan (1)
Affiliations
(1) JMP Statistical Discovery LLC
Journal
2024 Annual Reliability and Maintainability Symposium (RAMS)
Date Published
2024
Abstract
Validating statistical software involves a variety of challenges. Of these, the most difficult is the selection of an effective set of test cases, sometimes referred to as the “test case selection problem”. To further complicate matters, for many statistical applications, development and validation are done by individuals who often have limited time to validate their application and may not have formal training in software validation techniques. As a result, it is imperative that the adopted validation method is efficient, as well as effective, and it should also be one that can be easily understood by individuals not trained in software validation techniques. As it turns out, the test case selection problem can be thought of as a design of experiments (DOE) problem.
Citation
King, C.B., Lekivetz, R.A. and Morgan, J.A., 2024, January. Applying design of experiments in testing and validation of statistical software. In 2024 Annual Reliability and Maintainability Symposium (RAMS) (pp. 1-6). IEEE, https://doi.org/10.1109/RAMS51492.2024.10457738.