Identifying Unusual Patterns that Might Indicate Data Integrity Issues
Identifying Unusual Patterns that Might Identify Data Integrity Issues
Video Player is loading.
Current Time 0:00
/
Duration 56:04
Loaded: 0.29%
00:00
Stream Type LIVE
Remaining Time -56:04
1x
- Chapters
- descriptions off, selected
- captions settings, opens captions settings dialog
- captions off, selected
- en (Main), selected
This is a modal window.
Beginning of dialog window. Escape will cancel and close the window.
End of dialog window.
This is a modal window. This modal can be closed by pressing the Escape key or activating the close button.
See how to:
- Explore Patterns
- Identify duplicate values
- Find Most Duplicated Values - values that appear most frequently within column
- Find Longest Runs - values that repeats in consecutive rows within column
- Find Longest Duplicated Sequences- sequence of values that repeats within column
- Find Duplicates Across Columns- sequence of values that appears in the same rows across multiple columns
- Use Rarity Score to interpret duplications
- Conceptually a pattern is about as likely as getting [rarity value] heads in a row when flipping a fair coin
- Statistically, -Log2(p); where p is probability of pattern assuming random ordering of values
- Identify unusual values
- Locate Formatted Width within cells - both overall and decimals
- Locate suspicious Fraction Lengths
- Locate suspicious Leading Digits that are too uniform
- Check distribution of leading digits against Benford's Law, which says, that in many naturally occurring groups of numbers, distribution of leading digit is not uniform
-
Log10( (d+1) / d), where d is leading digit
- Identify unexpected linear relationships where, within some group of consecutive rows (default is 10), one column has an exact linear relationship with another column
- Identify specification limit anomalies for columns with spec limit properties
- Locate Spec Limit Matches where limits in cells exactly match LSL or USL
- Compare Spec Limits Distribution to compare out-of-spec values to expected out-of-spec values
Resources:
- Kurt Schwitter on continued fraction
Start:
Wed, Jun 17, 2020 02:00 PM EDT
End:
Wed, Jun 17, 2020 03:00 PM EDT
Upcoming Events
-
Tips and Tricks – From Tables to Graphs and Beyond
Feb 28JMP includes shortcuts and capabilities that can streamline your JMP analyses and reporting. Learn interesting shortcuts and tips, including tho... -
Disentangling and Organizing Wide Data
Feb 14Do you have wide data where each observation occupies a single row, and where you have individual or groups of columns useful for making predictions?... -
EMEA Mastering JMP: Understanding and Modeling Response Curves
Jan 31Learn how to analyze sequential measurement data where measurements you want to analyze as responses are not single points, but a range of points pres...
0 Comments