On the generalizability of diffusion MRI signal representations across acquisition parameters, sequences and tissue types: chronicles of the MEMENTO challenge
Alberto de Luca
(1, 2)
,
Andrada Ianus
(3)
,
Alexander Leemans
(1)
,
Marco Palombo
(4)
,
Noam Shemesh
(3)
,
Hui Zhang
(5)
,
Daniel C Alexander
(5)
,
Markus Nilsson
(6)
,
Martijn Froeling
(7)
,
Geert-Jan Biessels
(2)
,
Mauro Zucchelli
(8)
,
Matteo Frigo
(8)
,
Enes Albay
(9)
,
Sara Sedlar
(8)
,
Abib Alimi
(8)
,
Samuel Deslauriers-Gauthier
(8)
,
Rachid Deriche
(8)
,
Rutger H.J. Fick
(10)
,
Maryam Afzali
(11)
,
Tomasz Pieciak
(12, 13)
,
Fabian Bogusz
(12)
,
Santiago Aja-Fernández
(13)
,
Evren Özarslan
(14)
,
Derek Jones
(11)
,
Haoze Chen
(15)
,
Mingwu Jin
(16)
,
Zhijie Zhang
(15)
,
Fengxiang Wang
(15)
,
Vishwesh Nath
(17)
,
Prasanna Parvathaneni
(18)
,
Jan Morez
(19)
,
Jan Sijbers
(19)
,
Ben Jeurissen
(19)
,
Shreyas Fadnavis
(20)
,
Stefan Endres
(21)
,
Ariel Rokem
(22)
,
Eleftherios Garyfallidis
(20)
,
Irina Sanchez
(23)
,
Vesna Prchkovska
(23)
,
Paulo Rodrigues
(23)
,
Bennet Landman
(24)
,
Kurt Schilling
(25, 24)
1
ISI -
Image sciences institute - University of Utrecht
2 Utrecht Brain Center [UMC]
3 Champalimaud Centre for the Unknown [Lisbon]
4 LMN - Laboratoire des Maladies Neurodégénératives - UMR 9199
5 CMIC - Centre for Medical Image Computing
6 Department of Forest Ecology and Management
7 UMCU - University Medical Center [Utrecht]
8 ATHENA - Computational Imaging of the Central Nervous System
9 ITÜ - Istanbul Technical University
10 TRIBVN Healthcare
11 CUBRIC - Cardiff University's Brain Research Imaging Centre [Cardiff]
12 AGH-UST - Department of Automatics
13 LPI - Laboratorio de Procesado de Imagen [Valladolid]
14 Department of Biomedical Engineering [Linköping]
15 Taiyuan University of Technology
16 University of Texas at Arlington [Arlington]
17 NVIDIA - NVIDIA
18 NIH - National Institutes of Health [Bethesda, MD, USA]
19 Vision Lab [Antwerp]
20 Indiana University [Bloomington]
21 IWT - Institute of Materials Engineering [Bremen]
22 University of Washington [Seattle]
23 QMENTA Inc
24 Vanderbilt University [Nashville]
25 Vanderbilt University Medical Center [Nashville]
2 Utrecht Brain Center [UMC]
3 Champalimaud Centre for the Unknown [Lisbon]
4 LMN - Laboratoire des Maladies Neurodégénératives - UMR 9199
5 CMIC - Centre for Medical Image Computing
6 Department of Forest Ecology and Management
7 UMCU - University Medical Center [Utrecht]
8 ATHENA - Computational Imaging of the Central Nervous System
9 ITÜ - Istanbul Technical University
10 TRIBVN Healthcare
11 CUBRIC - Cardiff University's Brain Research Imaging Centre [Cardiff]
12 AGH-UST - Department of Automatics
13 LPI - Laboratorio de Procesado de Imagen [Valladolid]
14 Department of Biomedical Engineering [Linköping]
15 Taiyuan University of Technology
16 University of Texas at Arlington [Arlington]
17 NVIDIA - NVIDIA
18 NIH - National Institutes of Health [Bethesda, MD, USA]
19 Vision Lab [Antwerp]
20 Indiana University [Bloomington]
21 IWT - Institute of Materials Engineering [Bremen]
22 University of Washington [Seattle]
23 QMENTA Inc
24 Vanderbilt University [Nashville]
25 Vanderbilt University Medical Center [Nashville]
Martijn Froeling
- Fonction : Auteur
- PersonId : 784752
- ORCID : 0000-0003-3841-0497
Mauro Zucchelli
- Fonction : Auteur
- PersonId : 179500
- IdHAL : mauro-zucchelli
- ORCID : 0000-0002-7109-2884
- IdRef : 253122155
Matteo Frigo
- Fonction : Auteur
- PersonId : 17853
- IdHAL : matteofrigo
- ORCID : 0000-0002-9365-8017
Abib Alimi
- Fonction : Auteur
- PersonId : 741908
- IdHAL : abib-alimi
- ORCID : 0000-0002-7552-4744
- IdRef : 253122031
Samuel Deslauriers-Gauthier
- Fonction : Auteur
- PersonId : 750858
- IdHAL : samuel-deslauriers-gauthier
- ORCID : 0000-0003-2781-121X
Rutger H.J. Fick
- Fonction : Auteur
- PersonId : 3509
- IdHAL : rutger-fick
- IdRef : 200687263
Zhijie Zhang
- Fonction : Auteur
- PersonId : 806331
- ORCID : 0000-0003-0463-2665
Ariel Rokem
- Fonction : Auteur
- PersonId : 777630
- ORCID : 0000-0003-0679-1985
Résumé
Diffusion MRI (dMRI) has become an invaluable tool to assess the microstructural organization of brain tissue. Depending on the specific acquisition settings, the dMRI signal encodes specific properties of the underlying diffusion process. In the last two decades, several signal representations have been proposed to fit the dMRI signal and decode such properties. Most methods, however, are tested and developed on a limited amount of data, and their applicability to other acquisition schemes remains unknown. With this work, we aimed to shed light on the generalizability of existing dMRI signal representations to different diffusion encoding parameters and brain tissue types. To this end, we organized a community challenge - named MEMENTO, making available the same datasets for fair comparisons across algorithms and techniques. We considered two state-of-the-art diffusion datasets, including single-diffusion-encoding (SDE) spin-echo data from a human brain with over 3820 unique diffusion weightings (the MASSIVE dataset), and double (oscillating) diffusion encoding data (DDE/DODE) of a mouse brain including over 2520 unique data points. A subset of the data sampled in 5 different voxels was openly distributed, and the challenge participants were asked to predict the remaining part of the data. After one year, eight participant teams submitted a total of 80 signal fits. For each submission, we evaluated the mean squared error, the variance of the prediction error and the Bayesian information criteria. Most predictions predicted either multi-shell SDE data (37%) or DODE data (22%), followed by cartesian SDE data (19%) and DDE (18%). Most submissions predicted the signals measured with SDE remarkably well, with the exception of low and very strong diffusion weightings. The prediction of DDE and DODE data seemed more challenging, likely because none of the submissions explicitly accounted for diffusion time and frequency. Next to the choice of the model, decisions on fit procedure and hyperparameters play a major role in the prediction performance, highlighting the importance of optimizing and reporting such choices. This work is a community effort to highlight strength and limitations of the field at representing dMRI acquired with trending encoding schemes, gaining insights into how different models generalize to different tissue types and fiber configurations over a large range of diffusion encodings.