Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge. - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE Transactions on Medical Imaging Year : 2011

Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge.

1 ISI - Image sciences institute - University of Utrecht
2 Department of Electrical and Computer Engineering [Iowa]
3 Philips Research [Germany]
4 Siemens [Beijing]
5 State Key Laboratory of Chemical Engineering (Polymerization Division)
6 Service DREAM
7 Mauna Kea Technologies
8 ASCLEPIOS - Analysis and Simulation of Biomedical Images
9 VisAGeS - Vision, Action et Gestion d'informations en Santé
10 CAMPAR - Computer Aided Medical Procedures & Augmented Reality
11 GALEN - Organ Modeling through Extraction, Representation and Understanding of Medical Image Content
12 MAS - Mathématiques Appliquées aux Systèmes - EA 4037
13 DIKU - Department of Computer Science [Copenhagen]
14 BIG - Biomedical Imaging Group [Rotterdam]
15 CMS Software
16 IBME - Institute of Biomedical Engineering [Oxford]
17 Department of Clinical Neurology [Oxford]
18 CMIC - Centre for Medical Image Computing
19 CIM - Centre for Intelligent Machines
20 Montreal Neurological Institute and Hospital
21 MNI - McConnell Brain Imaging Centre
22 Massachusetts General Hospital [Boston]
23 Institute of Medical Informatics [Lübeck]
24 Medical imaging research center [Leuven]
25 PICSL - Penn Image Computing & Science Lab [Philadelphia]
26 Department of radiology and medical imaging [Charlottesville]
27 Division of image processing [Leiden]
28 ICG - Institute for Computer Graphics and Vision [Graz]
29 CREATIS - Centre de Recherche en Acquisition et Traitement de l'Image pour la Santé
30 Imagerie Tomographique et Radiothérapie
Xiang Deng
  • Function : Author
Vincent Garcia
  • Function : Author
Xiao Han
  • Function : Author
  • PersonId : 934513
Marc Modat
Stefan Klein
Simon Rit
David Sarrut


EMPIRE10 (Evaluation of Methods for Pulmonary Image REgistration 2010) is a public platform for fair and meaningful comparison of registration algorithms which are applied to a database of intrapatient thoracic CT image pairs. Evaluation of nonrigid registration techniques is a nontrivial task. This is compounded by the fact that researchers typically test only on their own data, which varies widely. For this reason, reliable assessment and comparison of different registration algorithms has been virtually impossible in the past. In this work we present the results of the launch phase of EMPIRE10, which comprised the comprehensive evaluation and comparison of 20 individual algorithms from leading academic and industrial research groups. All algorithms are applied to the same set of 30 thoracic CT pairs. Algorithm settings and parameters are chosen by researchers expert in the configuration of their own method and the evaluation is independent, using the same criteria for all participants. All results are published on the EMPIRE10 website (http://empire10.isi.uu.nl). The challenge remains ongoing and open to new participants. Full results from 24 algorithms have been published at the time of writing. This paper details the organization of the challenge, the data and evaluation methods and the outcome of the initial launch with 20 algorithms. The gain in knowledge and future work are discussed.
Embargoed file
Embargoed file
Visibility date is undetermined

Dates and versions

inserm-00607794 , version 1 (11-07-2011)



Keelin Murphy, Bram van Ginneken, Joseph M. Reinhardt, Sven Kabus, Kai Ding, et al.. Evaluation of registration methods on thoracic CT: the EMPIRE10 challenge.. IEEE Transactions on Medical Imaging, 2011, 30 (11), pp.1901-20. ⟨10.1109/TMI.2011.2158349⟩. ⟨inserm-00607794⟩
1242 View
4 Download



Gmail Facebook X LinkedIn More