A Study on the Fusion of Pixels and Patient Metadata in CNN-Based Classification of Skin Lesion Images - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

A Study on the Fusion of Pixels and Patient Metadata in CNN-Based Classification of Skin Lesion Images

Résumé

We present a study on the fusion of pixel data and patient metadata (age, gender, and body location) for improving the classification of skin lesion images. The experiments have been conducted with the ISIC 2019 skin lesion classification challenge data set. Taking two plain convolutional neural networks (CNNs) as a baseline, metadata are merged using either non-neural machine learning methods (tree-based and support vector machines) or shallow neural networks. Results show that shallow neural networks outperform other approaches in all overall evaluation measures. However, despite the increase in the classification accuracy (up to +19.1%), interestingly, the average per-class sensitivity decreases in three out of four cases for CNNs, thus suggesting that using metadata penalizes the prediction accuracy for lower represented classes. A study on the patient metadata shows that age is the most useful metadatum as a decision criterion, followed by body location and gender.
Fichier principal
Vignette du fichier
497121_1_En_11_Chapter.pdf (3.98 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03414735 , version 1 (04-11-2021)

Licence

Paternité

Identifiants

Citer

Fabrizio Nunnari, Chirag Bhuvaneshwara, Abraham Obinwanne Ezema, Daniel Sonntag. A Study on the Fusion of Pixels and Patient Metadata in CNN-Based Classification of Skin Lesion Images. 4th International Cross-Domain Conference for Machine Learning and Knowledge Extraction (CD-MAKE), Aug 2020, Dublin, Ireland. pp.191-208, ⟨10.1007/978-3-030-57321-8_11⟩. ⟨hal-03414735⟩
82 Consultations
53 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More