cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
JMP is taking Discovery online, April 16 and 18. Register today and join us for interactive sessions featuring popular presentation topics, networking, and discussions with the experts.
Choose Language Hide Translation Bar
triunk
Level I

Tricky Question about Intraclass Correlation

JMP 11 and 10 has a great module entitled Quality and Process. In one option (i.e. measurement system analysis) it is offering EMP results which include intraclass Correlation coefficient

QUESTION: Can this ICC coefficient of EMP results be used for evaluating the appropriateness of a Multilevel Model (HLM) or Mixed Model procedure???

Or it can be used only in situations of inter-rater reliability???

Thank you

T

2 ACCEPTED SOLUTIONS

Accepted Solutions

Re: Tricky Question about Intraclass Correlation

Hi, 

The model used in the Measurement Systems Analysis EMP platform is a random effects model that is specifically tailored to measurement systems analysis where you are measuring something, which we refer to as a part.  The ICC shown in the EMP results gives the proportion of variation in your measurements that can be attributed to variation in the parts.  The only case in which you could view these EMP models as a simple multilevel model is when you have a part variable but no grouping variables.  

If you would like to calculate an intraclass correlation coefficient for a multilevel model, it is possible to do this for simple multilevel models using REML in JMP or for more complicated multilevel models in JMP Pro version 11.  The intraclass correlations  can be easily
computed based on the covariance parameter estimates found in the report.

I hope this helps.

Laura

View solution in original post

Re: Tricky Question about Intraclass Correlation

Hi Christos,

Here is a link to some online documentation for REML:

http://www.jmp.com/support/help/Mixed_and_Random_Effect_Model_Reports_and_Options.shtml#739666

Here is a link to some online documentation for the new Mixed Models platform in JMP Pro 11:

http://www.jmp.com/support/help/Mixed_Models.shtml#1107706

This blog post might also be helpful if you have JMP Pro 11:

JMP Pro for linear mixed models — Part 1 http://blogs.sas.com/content/jmp/2014/04/10/jmp-pro-for-linear-mixed-models-part-1/

I hope that helps.

Laura

View solution in original post

4 REPLIES 4

Re: Tricky Question about Intraclass Correlation

Hi, 

The model used in the Measurement Systems Analysis EMP platform is a random effects model that is specifically tailored to measurement systems analysis where you are measuring something, which we refer to as a part.  The ICC shown in the EMP results gives the proportion of variation in your measurements that can be attributed to variation in the parts.  The only case in which you could view these EMP models as a simple multilevel model is when you have a part variable but no grouping variables.  

If you would like to calculate an intraclass correlation coefficient for a multilevel model, it is possible to do this for simple multilevel models using REML in JMP or for more complicated multilevel models in JMP Pro version 11.  The intraclass correlations  can be easily
computed based on the covariance parameter estimates found in the report.

I hope this helps.

Laura

triunk
Level I

Re: Tricky Question about Intraclass Correlation

Hi Laura,

Thank YOU very much for your answer. Is there any online reference material for doing this analysis in JMP following the steps you outlined besides your insightful answer?

Cheers

Christos

Re: Tricky Question about Intraclass Correlation

Hi Christos,

Here is a link to some online documentation for REML:

http://www.jmp.com/support/help/Mixed_and_Random_Effect_Model_Reports_and_Options.shtml#739666

Here is a link to some online documentation for the new Mixed Models platform in JMP Pro 11:

http://www.jmp.com/support/help/Mixed_Models.shtml#1107706

This blog post might also be helpful if you have JMP Pro 11:

JMP Pro for linear mixed models — Part 1 http://blogs.sas.com/content/jmp/2014/04/10/jmp-pro-for-linear-mixed-models-part-1/

I hope that helps.

Laura

triunk
Level I

Re: Tricky Question about Intraclass Correlation

It helps a lot, thank you very much

Christos