cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
New to using JMP? Hit the ground running with the Early User Edition of Discovery Summit. Register now, free of charge.
Register for our Discovery Summit 2024 conference, Oct. 21-24, where you’ll learn, connect, and be inspired.
Choose Language Hide Translation Bar

PCA + clustering analysis for spectral data

Hello!

I was wondering if anyone can help me out on the steps towards doing PCA + clustering analysis of spectral data?

I have already normalized all my spectral data (intensities). I have samples that vary in terms of composition and then each of them go through different processing steps. I hope that multivariate techniques can help me by discussing which is better (composition or processing step) in terms of clustering samples.

Should it be useful, I've attached a short version of my data.

 

 

Thanks in advance!!

Mariana

1 ACCEPTED SOLUTION

Accepted Solutions
Victor_G
Super User

Re: PCA + clustering analysis for spectral data

Hi @Mariana_Aguilar,

 

I see at least 2 options to explore your curve dataset (one with JMP, the second one with JMP Pro) :

  1. With JMP : You could use the platform Fit Curve with a stacked data format, setting "Intensity normalized" as Y, "Wavelength (nm)" as X and "Sample" as By variables. Then, you can fit a Skew Normal Peak (available in Peak models in the red triangle) to your 4 samples, and extract the fitted curves parameters : Location, Scale, Skew and Peak value (right-click on table "Parameter Estimates" and click on "Make combined datatable"). A new table will open in a stack format.
    You can split this table and use the parameter estimates in the PCA platform, to assess how similar/different are the two processes and composition :
    Victor_G_0-1724311224159.png

    Most of the variation seems to come from the process, with the first principal component responsible for approximately 95% of the variation in parameters values and linked to process.
    Hierarchical clustering would also show you that the biggest difference between samples could be linked to a difference in process (pasteurization vs. dispersion, first split in the clustering) :

    Victor_G_1-1724311743447.png

     

  2. With JMP Pro : You can use the Functional Data Explorer with a stacked data format, setting "Intensity normalized" as Y, Output, "Wavelength (nm)" as X, Input and "Sample" as ID, Function variables.
    You can then fit a B-Spline model to your curve data, and a cubic model with 17 splines should work well :

    Victor_G_2-1724312180573.png

    You can then directly look at the Score plot to visualize your samples with one or two Functional Principal components :

    Victor_G_3-1724312348138.png

    You'll once again see that process seems to be the biggest difference in the curve profiles of your sample (corresponding to FPC1 responsible for 99,8% of the variation in the curve data).

This process importance conclusion can also easily be visualized through Graph Builder (the two samples ID are very similar, but the change in curve can be mostly be imputed to process differences) :

Victor_G_0-1724325400975.png

 

 Please find scripts to follow the analysis described here in the attached datatable.

I hope these two solutions may help you,

Victor GUILLER
Scientific Expertise Engineer
L'Oréal - Data & Analytics

View solution in original post

5 REPLIES 5
Victor_G
Super User

Re: PCA + clustering analysis for spectral data

Hi @Mariana_Aguilar,

 

I see at least 2 options to explore your curve dataset (one with JMP, the second one with JMP Pro) :

  1. With JMP : You could use the platform Fit Curve with a stacked data format, setting "Intensity normalized" as Y, "Wavelength (nm)" as X and "Sample" as By variables. Then, you can fit a Skew Normal Peak (available in Peak models in the red triangle) to your 4 samples, and extract the fitted curves parameters : Location, Scale, Skew and Peak value (right-click on table "Parameter Estimates" and click on "Make combined datatable"). A new table will open in a stack format.
    You can split this table and use the parameter estimates in the PCA platform, to assess how similar/different are the two processes and composition :
    Victor_G_0-1724311224159.png

    Most of the variation seems to come from the process, with the first principal component responsible for approximately 95% of the variation in parameters values and linked to process.
    Hierarchical clustering would also show you that the biggest difference between samples could be linked to a difference in process (pasteurization vs. dispersion, first split in the clustering) :

    Victor_G_1-1724311743447.png

     

  2. With JMP Pro : You can use the Functional Data Explorer with a stacked data format, setting "Intensity normalized" as Y, Output, "Wavelength (nm)" as X, Input and "Sample" as ID, Function variables.
    You can then fit a B-Spline model to your curve data, and a cubic model with 17 splines should work well :

    Victor_G_2-1724312180573.png

    You can then directly look at the Score plot to visualize your samples with one or two Functional Principal components :

    Victor_G_3-1724312348138.png

    You'll once again see that process seems to be the biggest difference in the curve profiles of your sample (corresponding to FPC1 responsible for 99,8% of the variation in the curve data).

This process importance conclusion can also easily be visualized through Graph Builder (the two samples ID are very similar, but the change in curve can be mostly be imputed to process differences) :

Victor_G_0-1724325400975.png

 

 Please find scripts to follow the analysis described here in the attached datatable.

I hope these two solutions may help you,

Victor GUILLER
Scientific Expertise Engineer
L'Oréal - Data & Analytics

Re: PCA + clustering analysis for spectral data

Hi Victor, thank you for your kind and thorough answer.

I have a couple more questions if you don't mind...

1. For the first option (using the Fit Curve menu). I can't seem to find the Skew Normal Peaks under the Peak Models menu. I've tried with Gaussian (green) but at least visually it doesn't seem like a great fit. Then I tried with ExGaussian which seems better, but, I'm unsure on whether I'd be introducing more complexity onto my fitted curve parameters?

Mariana_Aguilar_2-1724684522897.png

 

Mariana_Aguilar_1-1724684183743.png

 

And my second question is in regards of the second option.

From the Functional Data Explorer Platform, do you know how can I save the Principal Components obtained so that I can proceed with Hierarchical clustering? (or if there's another option within the platform to move on to clustering?)

Thank you so much!

Mariana

Re: PCA + clustering analysis for spectral data

Oh one more doubt if I may!

In the functional data explorer platform, what's the difference between doing B-Spline to pre-process the data first vs going straight to use Direct Functional PCA on the models menu (under the red triangle):

Mariana_Aguilar_3-1724685238046.png

thank you!

Victor_G
Super User

Re: PCA + clustering analysis for spectral data

Hi @Mariana_Aguilar,

 

Concerning your questions :

  1. I think this new model type "Skew Normal Peak" has only been introduced in JMP 18, so if you're working with JMP 17, you will only have access to the three choices you mentioned : Fit Curve Options
    If you can't have JMP 18 for the moment, I agree that ExGaussian might be a more suitable modeling option, as it seems your peaks are a little skewed. The Gaussian peak model is more appropriate if you have symetrical gaussian peak.
    I don't understand how ExGaussian might add more "complexity" in the model, as there will be only a difference of one parameter in the model complexity between ExGaussian and Gaussian. Looking at information criteria AICc and BIC, you can see that adding one parameter does improve the modeling, there is a better balance between model fit and model complexity (the lower the information criterion AICc/BIC, the better).
  2. In the Functional Data Explorer platform, you can save the Functional Principal Components : go into the "Function Summaries" panel, click on the red triangle, and from there you can customize and save the function summaries and FPCs : 
    Victor_G_0-1724685690330.png

    You can directly visualize your samples in a 2D plot with the FPCs when looking at the Score plot :

    Victor_G_1-1724685785789.png

     

I hope these complementary answers will help you,

Victor GUILLER
Scientific Expertise Engineer
L'Oréal - Data & Analytics

Re: PCA + clustering analysis for spectral data

Hi @Mariana_Aguilar,

 

I'd suggest you have a look at the following resources in Multivariate Analysis for spectral data from @Bill_Worley , they'll set you up well to understand the relevant tools in JMP to help:

 

https://www.jmp.com/en_be/articles/analyzing-spectral-data-multivariate-methods.html

https://community.jmp.com/t5/Mastering-JMP/Building-Predictive-Models-for-Correlated-and-High-Dimens... 

https://community.jmp.com/t5/Discovery-Summit-Americas-2020/Using-Multivariate-Tools-in-JMP-for-Anal...

 

Thanks,

Ben

 

 

 

“All models are wrong, but some are useful”