The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS)
Bjoern Menze
(1)
,
Andras Jakab
(2)
,
Stefan Bauer
(3)
,
Jayashree Kalpathy-Cramer
(4)
,
Keyvan Farahani
(5)
,
Justin Kirby
(5)
,
Yuliya Burren
(6)
,
Nicole Porz
(6)
,
Johannes Slotboom
(6)
,
Roland Wiest
(6)
,
Levente Lanczi
(7)
,
Elisabeth Gerstner
(4)
,
Marc-Andre Weber
(8, 9)
,
Tal Arbel
(10)
,
Brian Avants
(11)
,
Nicholas Ayache
(1)
,
Patricia Buendia
(12)
,
Louis Collins
(13)
,
Nicolas Cordier
(1)
,
Jason Corso
(14)
,
Antonio Criminisi
(15)
,
Tilak Das
(16)
,
Hervé Delingette
(1)
,
Cagatay Demiralp
(17)
,
Christopher Durst
(18)
,
Michel Dojat
(19)
,
Senan Doyle
(20)
,
Joana Festa
(21)
,
Florence Forbes
(20)
,
Ezequiel Geremia
(1)
,
Ben Glocker
(15)
,
Polina Golland
(22)
,
Xiaotao Guo
(23)
,
Andac Hamamci
(24)
,
Khan Iftekharuddin
(25)
,
Raj Jena
(26)
,
Nigel John
(27)
,
Ender Konukoglu
(4)
,
Danial Lashkari
(22)
,
Jose Antonio Mariz
(21)
,
Raphael Meier
(28)
,
Sergio Pereira
(21)
,
Doina Precup
(29)
,
S. J. Price
(30)
,
Tammy Riklin-Raviv
(22)
,
Syed Reza
(25)
,
Michael Ryan
(12)
,
Lawrence Schwartz
(23)
,
Hoo-Chang Shin
(31)
,
Jamie Shotton
(15)
,
Carlos Silva
(21)
,
Nuno Sousa
(32)
,
Nagesh Subbanna
(29)
,
Gabor Szekely
(33)
,
Thomas Taylor
(12)
,
Owen Thomas
(12)
,
Nicholas Tustison
(18)
,
Gozde Unal
(24)
,
Flor Vasseur
(19)
,
Max Wintermark
(34)
,
Dong Hye Ye
(35)
,
Liang Zhao
(14)
,
Binsheng Zhao
(36)
,
Darko Zikic
(15)
,
Marcel Prastawa
(37)
,
Mauricio Reyes
(3)
,
Koen van Leemput
(22, 38)
1
ASCLEPIOS -
Analysis and Simulation of Biomedical Images
2 CIR lab - Computational Image Analysis and Radiology
3 ISTB - Institute for Surgical Technology and Biomechanics [Bern]
4 Massachusetts General Hospital [Boston]
5 Department of Health and Human Services
6 Inselspital Bern
7 University of Debrecen
8 Division of Medical Physics in Radiology [Heidelberg]
9 Diagnostic and Interventional Radiology [Heidelberg]
10 CIM - Centre for Intelligent Machines
11 PICSL - Penn Image Computing & Science Lab [Philadelphia]
12 INFOTECH Soft
13 MNI - McConnell Brain Imaging Centre
14 SUNY - State University of New York
15 Microsoft - Microsoft Research [Cambridge]
16 CUH - Cambridge University Hospitals - NHS
17 Computer Science Department [Stanford]
18 Department of radiology and medical imaging [Charlottesville]
19 GIN - Grenoble Institut des Neurosciences
20 MISTIS - Modelling and Inference of Complex and Structured Stochastic Systems
21 Universidade do Minho = University of Minho [Braga]
22 CSAIL - Computer Science and Artificial Intelligence Laboratory [Cambridge]
23 Columbia University [New York]
24 Sabanci University - Faculty of Engineering and Natural Sciences
25 ODU - Old Dominion University [Norfolk]
26 Addenbrooke's Hospital
27 Bangor University
28 Department of Surgery
29 McGill University = Université McGill [Montréal, Canada]
30 Bristol Glaciology Centre
31 Molecular Carcinogenesis [Sutton]
32 CNC - Center for Neuroscience and Cell Biology (CNC)
33 Computer Vision Laboratory - ETHZ [Zurich]
34 Department of Radiology [San Francisco]
35 Purdue University [West Lafayette]
36 Department of Computer Science [New York]
37 SCI Institute - Scientific Computing and Imaging Institute
38 Massachusetts General Hospital - Department of radiology
2 CIR lab - Computational Image Analysis and Radiology
3 ISTB - Institute for Surgical Technology and Biomechanics [Bern]
4 Massachusetts General Hospital [Boston]
5 Department of Health and Human Services
6 Inselspital Bern
7 University of Debrecen
8 Division of Medical Physics in Radiology [Heidelberg]
9 Diagnostic and Interventional Radiology [Heidelberg]
10 CIM - Centre for Intelligent Machines
11 PICSL - Penn Image Computing & Science Lab [Philadelphia]
12 INFOTECH Soft
13 MNI - McConnell Brain Imaging Centre
14 SUNY - State University of New York
15 Microsoft - Microsoft Research [Cambridge]
16 CUH - Cambridge University Hospitals - NHS
17 Computer Science Department [Stanford]
18 Department of radiology and medical imaging [Charlottesville]
19 GIN - Grenoble Institut des Neurosciences
20 MISTIS - Modelling and Inference of Complex and Structured Stochastic Systems
21 Universidade do Minho = University of Minho [Braga]
22 CSAIL - Computer Science and Artificial Intelligence Laboratory [Cambridge]
23 Columbia University [New York]
24 Sabanci University - Faculty of Engineering and Natural Sciences
25 ODU - Old Dominion University [Norfolk]
26 Addenbrooke's Hospital
27 Bangor University
28 Department of Surgery
29 McGill University = Université McGill [Montréal, Canada]
30 Bristol Glaciology Centre
31 Molecular Carcinogenesis [Sutton]
32 CNC - Center for Neuroscience and Cell Biology (CNC)
33 Computer Vision Laboratory - ETHZ [Zurich]
34 Department of Radiology [San Francisco]
35 Purdue University [West Lafayette]
36 Department of Computer Science [New York]
37 SCI Institute - Scientific Computing and Imaging Institute
38 Massachusetts General Hospital - Department of radiology
Bjoern Menze
- Fonction : Auteur
- PersonId : 727
- IdHAL : bjoern-menze
- ORCID : 0000-0003-4136-5690
- IdRef : 191610844
Nicholas Ayache
- Fonction : Auteur
- PersonId : 833436
- IdHAL : nicholas-ayache
Hervé Delingette
- Fonction : Auteur
- PersonId : 2424
- IdHAL : herve-delingette
- ORCID : 0000-0001-6050-5949
- IdRef : 050645714
Michel Dojat
- Fonction : Auteur
- PersonId : 1720
- IdHAL : michel-dojat
- ORCID : 0000-0003-2747-6845
- IdRef : 075440202
Senan Doyle
- Fonction : Auteur
- PersonId : 928965
Florence Forbes
- Fonction : Auteur
- PersonId : 16305
- IdHAL : florence-forbes
- ORCID : 0000-0003-3639-0226
- IdRef : 12469781X
Ezequiel Geremia
- Fonction : Auteur
- PersonId : 764717
- IdRef : 170040232
Ben Glocker
- Fonction : Auteur
- PersonId : 764547
- ORCID : 0000-0002-4897-9356
- IdRef : 183524535
Résumé
In this paper we report the set-up and results of the Multimodal Brain Tumor Image Segmentation (BRATS) benchmark organized in conjunction with the MICCAI 2012 and 2013 conferences. Twenty state-of-the-art tumor segmentation algorithms were applied to a set of 65 multi-contrast MR scans of low- and high-grade glioma patients - manually annotated by up to four raters - and to 65 comparable scans generated using tumor simulation software. Quantitative evaluations revealed considerable disagreement between the human raters in segmenting various tumor sub-regions (Dice scores in the range 74-85%), illustrating the difficulty of this task. We found that different algorithms worked best for different sub-regions (reaching performance comparable to human inter-rater variability), but that no single algorithm ranked in the top for all subregions simultaneously. Fusing several good algorithms using a hierarchical majority vote yielded segmentations that consistently ranked above all individual algorithms, indicating remaining opportunities for further methodological improvements. The BRATS image data and manual annotations continue to be publicly available through an online evaluation system as an ongoing benchmarking resource.
Domaines
Informatique| Origine | Fichiers produits par l'(les) auteur(s) |
|---|