This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Show  only  | Search instead for 
Did you mean: 
Choose Language Hide Translation Bar
Predictor Explainer (AutoML and Explainable AI in JMP + Python)
CAPEGA
CAPEGA
Level III
Created: Sep 14, 2022 05:24 AM  |  Last Modified: Sep 13, 2022 11:09 AM
Latest_PredictorExplainer.jmpaddin

Predictor explainer automates the screening of process variables using feature engineering and machine learning (known as AutoML). Parallel coordinate plots and trends will be automatically shown to interpret the results. If PyJMP is installed (optional), SHAP plots and UMAP will be automatically calculated as well.

 

CAPEGA_0-1663081128060.png

 

 

For further details and applications of ML applied to industrial processes, you can have a look at our open-access review: https://pubs.rsc.org/en/content/articlelanding/2022/re/d1re00541c

 

 

 

1 – Download and installation

Download and click the .jmpaddin file to install the latest version of Predictor Explainer from:

https://github.com/industrial-data/predictor-explainer  

 

If you have a previous version installed, it will be automatically removed.

 

PyJMP (Python for JMP) can be installed optionally.

https://github.com/industrial-data/pyjmp    

 

2 – Distillation column (continuous process)

In this example will be illustrate how to screen tags (sensor data) to quickly identify correlated factors to the yield in a distillation column.

CAPEGA_1-1663081128065.png

 

 

Go to the Add-ins menu and open Predictor Explainer.

CAPEGA_2-1663081128068.png

 

 

Predictor explainer contains example files. To open the folder, click in the button on the bottom left corner (see A in image below). The following steps are using the file ‘distillation_column_na.jmp’.

 

  • Select a target (Y)
  • Add all the input variables or predictors (X)
  • You can pass extra information such as date, supplementary information or weights. Grouping variables, will be used to create summary statistics before the analysis is done (automatic feature engineering).
  • You can specify several options, such as the creating of differences for all the input variables, the number of trees in the bootstrap forest, and the threshold for the signal to noise ratio.
  • Predictor Explainer will create a subset of the table and show the analysis results

(A) The add-in folder contains other example files and a python code

(B) If pyJMP is installed, additional options for SHAP and UMAP will be shown.

 

CAPEGA_3-1663081128077.png

 

 

The main results are:

 

  • Predictor screening (bootstrap forest) of the variables introduced or pre-calculated ones using grouping or differences.
  • Uniform and random noise columns will be added and used as threshold to select the strongest predictors. The signal-to-noise option parameter determines how much difference in contribution will be taken
  • A parallel coordinate plot will be shown with the top #3 variables. If signal is not strong enough compared to noise, this plot will not be shown.

 

CAPEGA_4-1663081128095.png

 

A hidden and temporal table with all the pre-selected predictors, target and time variables can be accessed via JMP home. The original analysis table won’t be modified.

CAPEGA_5-1663081128101.png

 

If PyJMP is installed and the option to show SHAP plots is activated, an interactive violin plot will appear after the analysis.

 

CAPEGA_6-1663081128109.png

 

Additional hidden tables containing SHAP, UMAP and clustering results will be accessible via the home menu.

 

3 – Batch data analysis

 

Predictor Explainer can also be used to screen sensors measuring batch processes. The file named ‘Fermentation_Batch_Data.jmp’ illustrates the challenge of combining unique values coming from a lab analysis with process data.

CAPEGA_7-1663081128117.png

 

Predictor explainer will first create a table with summary statistics (also called fingerprints or landmarks).

 

CAPEGA_8-1663081128124.png

 

If there is information about product (grade) or phase (stage) of the batch, these will be also used to generate more granular summary statistics. Using the noise contribution as a filter will eliminate all calculated features below it. When PhaseID is introduced as numeric and ordinal column (1, 2, 3…), an automatic aligning of the batch will be performed and shown.

 

In the example, Predictor Explainer identified the strongest sensor (tag).

CAPEGA_9-1663081128134.png

 

 

Creating your own version of the add-in

 

If you want to distribute or modify a new version of the JMP addin, there are two important things to consider.

 

  1. Changing the Jupyter notebook will not require changing the JMP add-in itself, as JMP calls the Python code independently via PyJMP. JMP will generate temporary files to communicate with Python and then read the results. The Jupyter Notebooks contains all the steps, to access it open the folder clicking the button on bottom left corner. There is one executable called open_notebook.bat which will allow you to modify the jupyter that is executed.
  2. When modifying the JML add-in source code and saving it (exporting application), make sure to keep the same Unique ID:

 

CAPEGA_10-1663081128137.png

 

As well as add the Notebook and other files you want to distribute with the add-in.

CAPEGA_11-1663081128138.png

 

In case you have suggestions, errors, or success stories (!) contact us

https://github.com/Industrial-data/predictor-explainer

 

 

Authors: Francisco Navarro, Carlos Perez-Galvan, Juline Gilliard

License: BSD-Clause 3

Code: github.com/industrial-data/predictor-explainer

Latest Version: 2022-09-12 (JMP 16)