Skip to search boxSkip to navigationSkip to main content

Raking Kappa: Describing Potential Impact of Marginal Distributions on Measures of Agreement

  • Alan Agrestib(Author)
    ,
  • Atalanta Ghoshb(Author)
    ,
  • Matilde Binia(Author)
  • aUniversity of Florence
    ,
  • bUniversity of Florida Gainesville
Research Output: Contribution to journal Article Peer-review

Publication Information

Output type

Research Output: Contribution to journal Article Peer-review

Original language

English

Pages from-to (Number of pages)

Pages 811-820 (10 pages)

Journal (Volume, Issue Number)

Biometrical Journal (Volume 37, Issue 7)

Publication milestones

  • Published - 01/01/1995

Publication status

Published - 01/01/1995

ISSN

0323-3847

External Publication IDs

  • Scopus: 84985698685

Abstract

Several authors have noted the dependence of kappa measures of inter‐rater agreement on the marginal distributions of contingency tables displaying the joint ratings. This paper introduces a smoothed version of kappa computed after raking the table to achieve pre‐specified marginal distributions. A comparison of kappa with raked kappa for various margins can indicate the extent of the dependence on the margins, and can indicate how much of the lack of agreement is due to marginal heterogeneity.

Access to documents

Publication metrics