Reproducible evaluation of methods for predicting progression to Alzheimer's disease from clinical and neuroimaging data - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2019

Reproducible evaluation of methods for predicting progression to Alzheimer's disease from clinical and neuroimaging data

Résumé

Various machine learning methods have been proposed for predicting progression of patients with mild cognitive impairment (MCI) to Alzheimer's disease (AD) using neuroimaging data. Even though the vast majority of these works use the public dataset ADNI, reproducing their results is complicated because they often do not make available elements that are essential for reproducibility, such as selected participants and input data, image preprocessing and cross-validation procedures. Comparability is also an issue. Specially, the influence of different components like preprocessing, feature extraction or classification algorithms on the performance is difficult to evaluate. Finally, these studies rarely compare their results to models built from clinical data only, a critical aspect to demonstrate the utility of neuroimaging. In our previous work, 1, 2 we presented a framework for reproducible and objective classification experiments in AD, that included automatic conversion of ADNI database into the BIDS community standard, image preprocessing pipelines and machine learning evaluation. We applied this framework to perform unimodal classifications of T1 MRI and FDG-PET images. In the present paper, we extend this work to the combination of multimodal clinical and neuroimaging data. All experiments are based on standard approaches (namely SVM and random forests). In particular, we assess the added value of neuroimaging over using only clinical data. We first demonstrate that using only demographic and clinical data (gender, education level, MMSE, CDR sum of boxes, ADASCog) results in a balanced accuracy of 75% (AUC of 0.84). This performance is higher than that of standard neuroimaging-based classifiers. We then propose a simple trick to improve the performance of neuroimaging-based classifiers: training from AD patients and controls (rather than from MCI patients) improves the performance of FDG-PET classification by 5 percent points, reaching the level of the clinical classifier. Finally, combining clinical and neuroimaging data, prediction results further improved to 80% balanced accuracy and an AUC of 0.88). These prediction accuracies, obtained in a reproducible way, provide a base to develop on top of it and, to compare against, more sophisticated methods. All the code of the framework and the experiments is publicly available at https://github.com/aramis-lab/AD-ML
Fichier principal
Vignette du fichier
2019_Samper_SPIE_FullPaper(1).pdf (262.75 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02025880 , version 1 (19-02-2019)
hal-02025880 , version 2 (21-02-2019)

Identifiants

Citer

Jorge Samper-Gonzalez, Ninon Burgos, Simona Bottani, Marie-Odile Habert, Theodoros Evgeniou, et al.. Reproducible evaluation of methods for predicting progression to Alzheimer's disease from clinical and neuroimaging data. SPIE Medical Imaging 2019, Feb 2019, San Diego, United States. ⟨10.1117/12.2512430⟩. ⟨hal-02025880v2⟩
318 Consultations
550 Téléchargements

Altmetric

Partager

More