Comprehensive decoding mental processes from Web repositories of functional brain images - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Scientific Reports Year : 2022

Comprehensive decoding mental processes from Web repositories of functional brain images

Abstract

Associating brain systems with mental processes requires statistical analysis of brain activity across many cognitive processes. These analyses typically face a difficult compromise between scope—from domain-specific to system-level analysis—and accuracy. Using all the functional Magnetic Resonance Imaging (fMRI) statistical maps of the largest data repository available, we trained machine-learning models that decode the cognitive concepts probed in unseen studies. For this, we leveraged two comprehensive resources: NeuroVault—an open repository of fMRI statistical maps with unconstrained annotations—and Cognitive Atlas—an ontology of cognition. We labeled NeuroVault images with Cognitive Atlas concepts occurring in their associated metadata. We trained neural networks to predict these cognitive labels on tens of thousands of brain images. Overcoming the heterogeneity, imbalance and noise in the training data, we successfully decoded more than 50 classes of mental processes on a large test set. This success demonstrates that image-based meta-analyses can be undertaken at scale and with minimal manual data curation. It enables broad reverse inferences, that is, concluding on mental processes given the observed brain activity.

Domains

Medical Imaging
Fichier principal
Vignette du fichier
article (1).pdf (9.34 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03666470 , version 1 (15-09-2022)

Identifiers

Cite

Romuald Menuet, Raphael Meudec, Jérôme Dockès, Gaël Varoquaux, Bertrand Thirion. Comprehensive decoding mental processes from Web repositories of functional brain images. Scientific Reports, 2022, 12 (7050), ⟨10.1038/s41598-022-10710-1⟩. ⟨hal-03666470⟩
218 View
47 Download

Altmetric

Share

Gmail Facebook X LinkedIn More