JMP Library

Latest Posts

• Constructing flexible space-filling designs for computer experiments

  Inventors Lekivetz, R.A., Morgan, J.A. and Jones, B.A. Patent Number U.S. Patent 10,503,846 Date Granted 12/10/2019 Description A computing device generates representative points, each representing a potential design point for a design space. The computing device determines for the design space primary clusters, a categorical factor, and at least two levels for the categorical factor. The computin...

  Ryan_Lekivetz

  Feb 1, 2026 5:23 AM

  125 views | 0 replies

• Interactive visualization tool for designed experiments

  Inventors King, C.B., Morgan, J.A. and Lekivetz, R.A. Patent Number U.S. Patent 10,386,271 Date Granted 08/20/2019 Description The computing device receives information representing a design of an experiment. The design of the experiment comprises a plurality of test cases. Each element of a test case of the design is a test condition for testing one of factors for the experiment. The computing de...

  Ryan_Lekivetz

  Feb 1, 2026 5:21 AM

  134 views | 0 replies

• Analysis of failures in combinatorial test suite

  Inventors Lekivetz, R.A., Morgan, J.A. and Jones, B.A. Patent Number U.S. Patent 10,338,993 Date Granted 07/02/2019 Description The computing device generates a test suite that provides test cases for testing a system. A test condition in the test suite comprises one of different levels representing different options assigned to a categorical factor for the system. The computing device receives in...

  Ryan_Lekivetz

  Feb 1, 2026 5:20 AM

  121 views | 0 replies

• Comparison and selection of experiment designs

  Inventors Morgan, J.A., Jones, B.A. and Lekivetz, R.A.  Patent Number U.S. Patent 10,296,680 Date Granted 05/21/2019 Description An apparatus may include a processor caused to: receive indications of selection of experiment designs to compare; receive indications of selection of a set of terms to include in the comparison; for each experiment design, generate a corresponding term correlation graph...

  Ryan_Lekivetz

  Feb 1, 2026 5:18 AM

  122 views | 0 replies

• Comparison and selection of experiment designs

  Inventors Morgan, J.A., Jones, B.A. and Lekivetz, R.A. Patent Number U.S. Patent 10,318,674 Date Granted 06/11/2019 Description An apparatus may include a processor caused to: receive indications of first and second experiment designs to be compared; for each factor of the model of the first experiment design, identify a matching factor of the model of the second experiment design based on factor ...

  Ryan_Lekivetz

  Feb 1, 2026 5:15 AM

  124 views | 0 replies

• MaLT: Machine-Learning-Guided Test Case Design and Fault Localization of Complex Software Systems

  Authors Yi Ji (1), Simon Mak (2), Ryan Lekivetz (1) and Joseph Morgan (1) Affiliations (1) JMP Statistical Discovery LLC (2) Duke University, Durham, NC Journal 2024 22nd ACM-IEEE International Symposium on Formal Methods and Models for System Design (MEMOCODE) Date Published 2024 Abstract Software testing is essential for the reliable and robust development of complex software systems. This is pa...

  Ryan_Lekivetz

  Jan 31, 2026 7:02 PM

  174 views | 0 replies

• Power Considerations in Designed Experiments

  Authors Luyao Lin (1), Derek Bingham (1) and Ryan Lekivetz (2) Affiliations (1) Simon Fraser University, Burnaby, BC (2) JMP Statistical Discovery LLC Journal Journal of Statistical Theory and Practice Date Published 2020 Abstract Designed experiments for ANOVA studies are ubiquitous across all areas of scientific endeavor. An important decision facing experimenter is that of the experiment run si...

  Ryan_Lekivetz

  Jan 31, 2026 6:53 PM

  124 views | 0 replies

• Assessing the Usability of Statistical Software Using a Discrete Choice Experiment

  Authors  Jacob Rhyne (1), Mark Bailey (1), Joseph Morgan (1), and Ryan Lekivetz (1) Affiliations (1) JMP Statistical Discovery LLC Journal International Conference on Human-Computer Interaction Date Published 2024 Abstract The usability [2, 3] of modern statistical software is increasingly important as users with limited statistical training become more reliant on such tools to help them address c...

  Ryan_Lekivetz

  Jan 31, 2026 6:49 PM

  151 views | 0 replies

• Applying design of experiments in testing and validation of statistical software

  Authors Caleb King (1), Ryan Lekivetz (1),  and Joseph Morgan (1) Affiliations (1) JMP Statistical Discovery LLC Journal 2024 Annual Reliability and Maintainability Symposium (RAMS) Date Published 2024 Abstract Validating statistical software involves a variety of challenges. Of these, the most difficult is the selection of an effective set of test cases, sometimes referred to as the “test case se...

  Ryan_Lekivetz

  Jan 31, 2026 6:45 PM

  129 views | 0 replies

• Development of a non-invasive method for species and sex identification of rare forest carnivores using footprint identification technology

  Authors Jody M. Tucker (1, 2), Caleb King (3), Ryan Lekivetz (3), Remi Murdoch (1), Zoe C. Jewell (3,4) and Sky K. Alibhai (3,4) Affiliations (1) USDA Forest Service, Rocky Mountain Research Station (2) USDA Forest Service, Pacific Southwest Region (3) JMP Statistical Discovery LLC (4) Nicholas School of the Environment, Duke University Journal Ecological Informatics Date Published 2024 Abstract M...

  Ryan_Lekivetz

  Jan 31, 2026 6:41 PM

  167 views | 0 replies

• BayesFLo: Bayesian fault localization for software testing

  Authors Yi Ji (1), Ryan Lekivetz (2), Simon Mak (1) and Joseph Morgan (1) Affiliations (1) Duke University, Durham, NC (2) JMP Statistical Discovery LLC Journal 2023 IEEE 23rd International Conference on Software Quality, Reliability, and Security Companion (QRS-C) Date Published 2023 Abstract Fault localization is a software testing activity that is critical when software failures occur. We propo...

  Ryan_Lekivetz

  Jan 31, 2026 6:36 PM

  140 views | 0 replies

• Assessing the usability of statistical software using designed experiments

  Authors Jacob Rhyne (1), Mark Bailey (1), Joseph Morgan (1) and Ryan Lekivetz (1) Affiliations (1) JMP Statistical Discovery LLC Journal International Conference on Human-Computer Interaction Date Published 2023 Abstract Modern statistical software is increasingly used by users with limited statistical training to address complex real-world problems. Yet, little work has been done on assessing the...

  Ryan_Lekivetz

  Jan 31, 2026 6:32 PM

  146 views | 0 replies

• A family of orthogonal main effects screening designs for mixed-level factors

  Authors Bradley Jones (1), Ryan Lekivetz (1) and Christopher Nachtsheim (2) Affiliations (1) JMP Statistical Discovery LLC (2) Carlson School of Management, University of Minnesota, Minneapolis, MN Journal Journal of Quality Technology Date Published 2023 Abstract There is limited literature on screening when some factors are at three levels and others are at two levels. This topic has seen renewe...

  Ryan_Lekivetz

  Jan 31, 2026 6:27 PM

  154 views | 0 replies

• Testing the prediction profiler with disallowed combinations—A statistical engineering case study

  Authors Jeremy Ash (1), Caleb King (1), Laura Lancaster (1), Ryan Lekivetz (1), Joseph Morgan (1) and Yeng Saanchi (1) Affiliations (1) JMP Statistical Discovery LLC Journal Quality Engineering Date Published 2022 Abstract The prediction profiler is an interactive display in JMP statistical software that allows a user to explore the relationships between multiple factors and responses. A common us...

  Ryan_Lekivetz

  Jan 31, 2026 6:23 PM

  143 views | 0 replies

• On the testing of statistical software

  Authors Ryan Lekivetz (1) and Joseph Morgan (1) Affiliations (1) JMP Statistical Discovery LLC Journal Journal of Statistical Theory and Practice Date Published 2021 Abstract Testing statistical software is an extremely difficult task. What is more, for many statistical packages, the developer and test engineer are one and the same, may not have formal training in software testing techniques, and ...

  Ryan_Lekivetz

  Jan 31, 2026 6:20 PM

  124 views | 0 replies

• Combinatorial testing: using blocking to assign test cases for validating complex software systems

  Authors Ryan Lekivetz (1) and Joseph Morgan (1) Affiliations (1) JMP Statistical Discovery LLC Journal Statistical Theory and Related Fields Date Published 2021 Abstract Testing complex software systems is an extraordinarily difficult task. Test engineers are faced with the challenging prospect of ensuring that a software system satisfies its requirements while working within a strict budget. Choo...

  Ryan_Lekivetz

  Jan 31, 2026 6:16 PM

  124 views | 0 replies

• Direct construction of globally D‐optimal designs for factors at two levels and main effects models

  Authors Caleb King (1), Bradley Jones (1), Joseph Morgan (1) and Ryan Lekivetz (1)  Affiliations (1) JMP Statistical Discovery LLC Journal Quality and Reliability Engineering International Date Published 2020 Abstract In developing screening experiments for two-level factors, practitioners typically are familiar with regular fractional factorial designs, which are orthogonal, glob-ally D-optimal (...

  Ryan_Lekivetz

  Jan 31, 2026 6:13 PM

  140 views | 0 replies

• Covering arrays: Using prior information for construction, evaluation and to facilitate fault localization

  Authors Ryan Lekivetz (1) and Joseph Morgan (1) Affiliations (1) JMP Statistical Discovery LLC Journal Journal of Statistical Theory and Practice Date Published 2020 Abstract Covering arrays are increasingly being used by test engineers to derive test cases to test complex engineered systems. This approach to testing is known as combinatorial testing and has proven to be a cost-efficient way to de...

  Ryan_Lekivetz

  Jan 31, 2026 6:08 PM

  110 views | 0 replies

• Construction, properties, and analysis of group-orthogonal supersaturated designs

  Authors Bradley Jones (1), Ryan Lekivetz (1), Dibyen Majumdar (2), Christopher Nachtsheim (3) and Jonathan Stallrich (4) Affiliations (1) JMP Statistical Discovery LLC (2) Department of Mathematics, Statistics, and Computer Science, University of Illinois, Chicago, Chicago, IL (3) Carlson School of Management, University of Minnesota, Minneapolis, MN (4) North Carolina State University, Raleigh, N...

  Ryan_Lekivetz

  Jan 31, 2026 6:05 PM

  178 views | 0 replies

• Design Fractals: A Graphical Method for Evaluating Binary Covering Arrays

  Authors Caleb King (1), Joseph Morgan (1) and Ryan Lekivetz (1) Affiliations (1) JMP Statistical Discovery LLC Journal 2019 IEEE 19th International Conference on Software Quality, Reliability and Security Companion (QRS-C) Date Published 2019 Abstract Test engineers are often faced with the challenge of selecting test cases that maximize the chance of discovering faults while working within a limi...

  Ryan_Lekivetz

  Jan 31, 2026 6:01 PM

  112 views | 0 replies

• Fast flexible space‐filling designs with nominal factors for nonrectangular regions

  Authors Ryan Lekivetz (1), and Joseph Morgan (1) Affiliations (1) JMP Statistical Discovery LLC Journal Quality and Reliability Engineering International Date Published 2019 Abstract Space‐filling designs allow for exploration of responses when each continuous input factor is set to many different values over its range. While typical space‐filling designs treat all the input factors as continuous,...

  Ryan_Lekivetz

  Jan 31, 2026 5:58 PM

  142 views | 0 replies

• Evaluation and construction of covering arrays utilizing prior information

  Authors Ryan Lekivetz (1) and Joseph Morgan (1) Affiliations (1) JMP Statistical Discovery LLC Journal 2018 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW) Date Published 2018 Abstract   Covering arrays are being increasingly used as a tool to determine test cases for testing complex engineered systems. The primary appeal of using covering arrays for this purpos...

  Ryan_Lekivetz

  Jan 31, 2026 5:56 PM

  131 views | 0 replies

• Fault Localization: Analyzing Covering Arrays Given Prior Information

  Authors Ryan Lekivetz (1) and Joseph Morgan (1) Affiliations (1) JMP Statistical Discovery LLC Journal 2018 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C) Date Published 2018 Abstract Covering arrays are being increasingly used as a tool to determine test cases for testing complex engineered systems. The primary appeal of using covering arrays for thi...

  Ryan_Lekivetz

  Jan 31, 2026 5:54 PM

  121 views | 0 replies

• Covering arrays: Evaluating coverage and diversity in the presence of disallowed combinations

  Authors Joseph Morgan (1), Ryan Lekivetz(1) and Tom Donnelly (1) Affiliations (1) JMP Statistical Discovery LLC Journal  2017 IEEE 28th Annual Software Technology Conference (STC) Date Published 2017 Abstract Test engineers are often faced with the challenge of selecting test cases that maximize the chance of discovering faults while working with a limited budget. Combinatorial testing is an effec...

  Ryan_Lekivetz

  Jan 31, 2026 5:51 PM

  149 views | 0 replies

• Designs of variable resolution robust to non-negligible two-factor interactions

  Authors Ryan Lekivetz (1) and C. Devon Lin (2) Affiliations (1) JMP Statistical Discovery LLC (2) Queen's University Journal Statistica Sinica Date Published 2016 Abstract In some experimental situations, there is a natural grouping of factors. Prior knowledge may indicate that active two-factor interactions only occur within groups of factors. Designs of variable resolution (Lin (2012)) were intr...

  Ryan_Lekivetz

  Jan 31, 2026 5:46 PM

  143 views | 0 replies