International variation in histologic grading is large, and persistent feedback does not improve reproducibility.

Furness, Peter N;Taub, Nicholas;Assmann, Karel J M;Banfi, Giovanni;Rosenthal, Rafail;et.al.
(2003) American Journal of Surgical Pathology — Vol. 27, n° 6, p. 805-810 (2003)

Files

No attached file found for this publication.

Details

Authors
  • Furness, Peter N
    Author
  • Taub, Nicholas
    Author
  • Assmann, Karel J M
    Author
  • Banfi, Giovanni
    Author
  • Cosyns, Jean-PierreUCLouvain
    Author
  • Rosenthal, Rafail
    Author
Show more
Abstract
Histologic grading systems are used to guide diagnosis, therapy, and audit on an international basis. The reproducibility of grading systems is usually tested within small groups of pathologists who have previously worked or trained together. This may underestimate the international variation of scoring systems. We therefore evaluated the reproducibility of an established system, the Banff classification of renal allograft pathology, throughout Europe. We also sought to improve reproducibility by providing individual feedback after each of 14 small groups of cases. Kappa values for all features studied were lower than any previously published, confirming that international variation is greater than interobserver variation as previously assessed. A prolonged attempt to improve reproducibility, using numeric or graphical feedback, failed to produce any detectable improvement. We then asked participants to grade selected photographs, to eliminate variation induced by pathologists viewing different areas of the slide. This produced improved kappa values only for some features. Improvement was influenced by the nature of the grade definitions. Definitions based on "area affected" by a process were not improved. The results indicate the danger of basing decisions on grading systems that may be applied very differently in different institutions.
Affiliations

Citations

Furness, P. N., Taub, N., Assmann, K. J. M., Banfi, G., Cosyns, J.-P., Dorman, A. M., Hill, C. M., Kapper, S. K., Waldherr, R., Laurinavicius, A., Marcussen, N., Martins, A. P., Nogueira, M., Regele, H., Seron, D., Carrera, M., Sund, S., Taskinen, E. I., Paavonen, T., et al. (2003). International variation in histologic grading is large, and persistent feedback does not improve reproducibility. American Journal of Surgical Pathology, 27(6), 805-810. https://doi.org/10.1097/00000478-200306000-00012 (Original work published 2003)