topic Re: Intraclass Correlation using a random effects model versus the MSA platform in Discussions

Intraclass Correlation using a random effects model versus the MSA platform

G_M — Fri, 09 Jun 2023 00:16:41 GMT

Good evening JMP Community,

Does someone have an explanation as to why the ICC calculated in the MSA platform (EMP) is different than the percent of variance explained in the variability or the fit model platform with random effects (REML)?

For example, I used the Animal sample data and concatenated the species and subjectID into a new column and used the new column as the between subjects factor and miles as the outcome. In the fit model and variability platforms I calculate an ICC of ~0.387 and in the MSA platform the ICC is ~0.4.

Attached is a pic of the two outputs.

Sincerely,

Re: Intraclass Correlation using a random effects model versus the MSA platform

Byron_JMP — Thu, 04 Jun 2020 13:10:00 GMT

its all about the sigmas

https://www.jmp.com/support/help/en/15.1/#page/jmp/statistical-details-for-measurement-systems-analysis.shtml#ww1389206

The REML variance components are calculated differently, and perhaps a little more precisely.

Take a look at the degrees of freedom in EMP too.

Re: Intraclass Correlation using a random effects model versus the MSA platform

Laura_Lancaster — Thu, 04 Jun 2020 14:02:21 GMT

Hi MG,

The EMP Measurement Systems Analysis platform uses ranges by default for calculating variation, but if you switch to using standard deviations in the launch dialog you should get results that match the Variability platform in your example.

Here are the results:

It is possible to set a platform preference to always use standard deviations if you prefer that to be the default.

I hope this helps. Thanks.

Laura

Re: Intraclass Correlation using a random effects model versus the MSA platform

G_M — Thu, 04 Jun 2020 14:51:13 GMT

Many thanks Byron and Laura. I appreciate the quick support!

Sincerely,

Re: Intraclass Correlation using a random effects model versus the MSA platform

ron_horne — Fri, 12 Jun 2020 19:37:52 GMT

Thank you @Laura_Lancaster for the clarification.

would it be possible to produce a list of ICC measurements available in JMP in the context of this list:
https://en.wikipedia.org/wiki/Intraclass_correlation#Calculation_in_software_packages

Many thanks,

Ron