NV-tree: An Efficient Disk-Based Index for Approximate Search in Very Large High-Dimensional Collections - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE Transactions on Pattern Analysis and Machine Intelligence Year : 2009

NV-tree: An Efficient Disk-Based Index for Approximate Search in Very Large High-Dimensional Collections

Abstract

Over the last two decades, much research effort has been spent on nearest neighbor search in high-dimensional data sets. Most of the approaches published thus far have, however, only been tested on rather small collections. When large collections have been considered, high-performance environments have been used, in particular systems with a large main memory. Accessing data on disk has largely been avoided because disk operations are considered to be too slow. It has been shown, however, that using large amounts of memory is generally not an economic choice. Therefore, we propose the NV-tree, which is a very efficient disk-based data structure that can give good approximate answers to nearest neighbor queries with a single disk operation, even for very large collections of high-dimensional data. Using a single NV-tree, the returned results have high recall but contain a number of false positives. By combining two or three NV-trees, most of those false positives can be avoided while retaining the high recall. Finally, we compare the NV-tree to locality sensitive hashing, a popular method for ??-distance search. We show that they return results of similar quality, but the NV-tree uses many fewer disk reads
No file

Dates and versions

hal-00794359 , version 1 (25-02-2013)

Identifiers

Cite

Herwig Lejsek, Friðrik-Heidar Heiðar Ásmundsson, Björn Þór Jónsson, Laurent Amsaleg. NV-tree: An Efficient Disk-Based Index for Approximate Search in Very Large High-Dimensional Collections. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009, 31 (5), pp.869-883. ⟨10.1109/TPAMI.2008.130⟩. ⟨hal-00794359⟩
330 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More