topic Re: Kappa Coefficient and Agreement Statistic in Discussions

Kappa Coefficient and Agreement Statistic

barik — Tue, 18 Oct 2016 20:42:40 GMT

Hi all,

Assume that I have two columns, Bob and Mary, who rate four items with either a Y or a N. In the following case, no Agreement Statistic is present when doing Fit Y by X, because it appears that JMP thinks that Bob and Mary do not have the same categorical levels. How can I set column "Bob" to inform JMP that Bob can also take on values or Y or N? For example, if I change one of the columns in Bob to N, the Agreement Statistic feature is available again.

I feel like this should be specified in Column Properties somewhere, but I can't figure out how to make it work.

Thanks!

Re: Kappa Coefficient and Agreement Statistic

Jeff_Perkinson — Tue, 18 Oct 2016 20:43:00 GMT

Hi Titus,

Try adding one more row to your data table with the N for Bob (either Y or N for Mary) and also add a Freq column with a 1 in every row except the new row – with the N in it for Bob – which should have a 0.

Use the Freq column in the Freq role in Fit Y by X and you should get the option for the Agreement Statistic.

-Jeff

Re: Kappa Coefficient and Agreement Statistic

pgstats — Tue, 18 Oct 2016 20:43:10 GMT

When one of the raters always says the same thing (Bob, in this case) Kappa is zero, by definition. You can show this by adding a weight variable and a dummy observation where Bob says N but with a weight of zero.