cancel
Showing results for 
Show  only  | Search instead for 
Did you mean: 
  • Don’t miss your chance to experience Discovery Summit Europe at our best available rate! Early bird registration through 31 Oct.
  • Graph Builder Toolbar streamlines interactive graphing. Creates shortcuts on Report and GraphBuilder Helpers toolbars. Download and install the extension.
  • JMP will suspend normal business operations for our Rest and Recharge Day on Friday, October 2, 2026.
    Regular business hours will resume on Monday, October 5, 2026.

Discussions

Solve problems, and share tips and tricks with other JMP users.
Choose Language Hide Translation Bar
barik
Level I

Kappa Coefficient and Agreement Statistic

Hi all,

Assume that I have two columns, Bob and Mary, who rate four items with either a Y or a N. In the following case, no Agreement Statistic is present when doing Fit Y by X, because it appears that JMP thinks that Bob and Mary do not have the same categorical levels. How can I set column "Bob" to inform JMP that Bob can also take on values or Y or N? For example, if I change one of the columns in Bob to N, the Agreement Statistic feature is available again.

6287_2014-05-12_20-32-34.png

I feel like this should be specified in Column Properties somewhere, but I can't figure out how to make it work.

Thanks!

1 ACCEPTED SOLUTION

Accepted Solutions
Jeff_Perkinson
Community Manager Community Manager

Re: Kappa Coefficient and Agreement Statistic

Hi Titus,

Try adding one more row to your data table with the N for Bob (either Y or N for Mary) and also add a Freq column with a 1 in every row except the new row – with the N in it for Bob – which should have a 0.

6289_BobMaryFreq.png

Use the Freq column in the Freq role in Fit Y by X and you should get the option for the Agreement Statistic.

6290_BobMaryFreqFitYbyX.png

6291_FitYByX.png

-Jeff

-Jeff

View solution in original post

2 REPLIES 2
Jeff_Perkinson
Community Manager Community Manager

Re: Kappa Coefficient and Agreement Statistic

Hi Titus,

Try adding one more row to your data table with the N for Bob (either Y or N for Mary) and also add a Freq column with a 1 in every row except the new row – with the N in it for Bob – which should have a 0.

6289_BobMaryFreq.png

Use the Freq column in the Freq role in Fit Y by X and you should get the option for the Agreement Statistic.

6290_BobMaryFreqFitYbyX.png

6291_FitYByX.png

-Jeff

-Jeff
pgstats
Level I

Re: Kappa Coefficient and Agreement Statistic

When one of the raters always says the same thing (Bob, in this case) Kappa is zero, by definition. You can show this by adding a weight variable and a dummy observation where Bob says N but with a weight of zero.

6293_snip.PNG

PG

Recommended Articles