Skin lesions of face and scalp - Classification by a market-approved convolutional neural network in comparison with 64 dermatologists.

Haenssle, Holger Andreas;Winkler, Julia Katharina;Fink, Christine;Toberer, Ferdinand;Reader study level-I and level-II Groups Christina Alt;et.al.
(2021) European Journal of Cancer — Vol. 144, p. 192-199 (2021)

Files

2021_Haenssle_Eur_J_Cancer.pdf
  • Open Access
  • Adobe PDF
  • 584.84 KB

Details

Authors
  • Haenssle, Holger Andreas
    Author
  • Winkler, Julia Katharina
    Author
  • Fink, Christine
    Author
  • Toberer, Ferdinand
    Author
  • Tromme, IsabelleUCLouvain
    Author
  • Reader study level-I and level-II Groups Christina Alt
    Collaborator
Show more
Abstract
BACKGROUND: The clinical differentiation of face and scalp lesions (FSLs) is challenging even for trained dermatologists. Studies comparing the diagnostic performance of a convolutional neural network (CNN) with dermatologists in FSL are lacking. METHODS: A market-approved CNN (Moleanalyzer-Pro, FotoFinder Systems) was used for binary classifications of 100 dermoscopic images of FSL. The same lesions were used in a two-level reader study including 64 dermatologists (level I: dermoscopy only; level II: dermoscopy, clinical close-up images, textual information). Primary endpoints were the CNN's sensitivity and specificity in comparison with the dermatologists' management decisions in level II. Generalizability of the CNN results was tested by using four additional external data sets. RESULTS: The CNN's sensitivity, specificity and ROC AUC were 96.2% [87.0%-98.9%], 68.8% [54.7%-80.1%] and 0.929 [0.880-0.978], respectively. In level II, the dermatologists' management decisions showed a mean sensitivity of 84.2% [82.2%-86.2%] and specificity of 69.4% [66.0%-72.8%]. When fixing the CNN's specificity at the dermatologists' mean specificity (69.4%), the CNN's sensitivity (96.2% [87.0%-98.9%]) was significantly higher than that of dermatologists (84.2% [82.2%-86.2%]; p < 0.001). Dermatologists of all training levels were outperformed by the CNN (all p < 0.001). In confirmation, the CNN's accuracy (83.0%) was significantly higher than dermatologists' accuracies in level II management decisions (all p < 0.001). The CNN's performance was largely confirmed in three additional external data sets but particularly showed a reduced specificity in one Australian data set including FSL on severely sun-damaged skin. CONCLUSIONS: When applied as an assistant system, the CNN's higher sensitivity at an equivalent specificity may result in an improved early detection of face and scalp skin cancers.
Affiliations

Citations

Haenssle, H. A., Winkler, J. K., Fink, C., Toberer, F., Enk, A., Stolz, W., Deinlein, T., Hofmann-Wellenhof, R., Kittler, H., Tschandl, P., Rosendahl, C., Lallas, A., Blum, A., Abassi, M. S., Thomas, L., Tromme, I., & Rosenberger, A. (2021). Skin lesions of face and scalp - Classification by a market-approved convolutional neural network in comparison with 64 dermatologists. European Journal of Cancer, 144, 192-199. https://doi.org/10.1016/j.ejca.2020.11.034 (Original work published 2021)