Can I read Beyond Kappa: an Informational Index for Diagnostic Agreement in Dichotomous and Multivalue Ordered-categorical Ratings on EtoBox?

Beyond Kappa: an Informational Index for Diagnostic Agreement in Dichotomous and Multivalue Ordered-categorical Ratings by Alberto Casagrande; Francesco Fabris; Rossano Girometti is a Medicine article available to read on EtoBox.

What is Beyond Kappa: an Informational Index for Diagnostic Agreement in Dichotomous and Multivalue Ordered-categorical Ratings about?

Agreement measures are useful tools to both compare different evaluations of the same diagnostic outcomes and validate new rating systems or devices. Cohen's kappa (κ) certainly is the most popular agreement method between two raters, and proved its effectiveness in the last sixty years. In spite of that, this method suffers from some alleged issues, which have been highlighted since the 1970s; moreover, its value is strongly dependent on the prevalence of the disease in the considered sample. This work introduces a new agreement index, the informational agreement (IA), which seems to avoid some of Cohen's kappa's flaws, and separates the contribution of the prevalence from the nucleus of agreement. These goals are achieved by modelling the agreement-in both dichotomous and multivalue ordered-categorical cases-as the information shared between two raters through the virtual diagnostic channel connecting them: the more information exchanged between the raters, the higher their agreement. In order to test its fair behaviour and the effectiveness of the method, IA has been tested on some cases known to be problematic for κ, in the machine learning context and in a clinical scenario to

Who reads Beyond Kappa: an Informational Index for Diagnostic Agreement in Dichotomous and Multivalue Ordered-categorical Ratings?

Author

Alberto Casagrande; Francesco Fabris; Rossano Girometti

Publisher

Springer; Springer-Verlag; Peter Peregrinus, Ltd.; Springer Verlag; International Federation For Medical Electronics; Springer Science and Business Media LLC; Society for Mining, Metallurgy and Exploration Inc. (ISSN 1741-0444)

Published

2020

Language

EN

Field

Medicine (Health Sciences)