Video Extruder: a semi-dense point tracker for extracting beam of trajectories in real time - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Journal of Real-Time Image Processing Année : 2014

Video Extruder: a semi-dense point tracker for extracting beam of trajectories in real time

Résumé

Two crucial aspects of visual point tracking are addressed in this paper. First, the algorithm should track as many points as possible reliably. Second, the computation should be fast enough, which is challeng- ing on low power embedded platforms. We propose a new multi-scale semi dense point tracker called Video Extruder, whose purpose is to fill the gap between short term, dense motion estimation (optical flow) and long term, sparse salient point tracking. This paper presents a new detector, including a new salience function with low computational complexity and a new selection strat- egy that allows to obtain a large number of keypoints. Its density and reliability in mobile video scenarios are com- pared with those of FAST detector. Then, a multi-scale prediction and a matching strategy are presented, based on a hybrid regional coarse-to-fine and temporal predic- tion, which provides robustness to large camera and ob- ject accelerations. Filtering and merging strategies are then used to eliminate most of the wrong or useless tra- jectories. Thanks to its high degree of parallelism, the proposed algorithm extracts beams of trajectories from the video in a very fast way. We compare it with the state-of-the-art pyramidal Lucas Kanade point tracker and show that, in fast mobile video scenarios, it yields similar quality results, while being up to one order of magnitude faster. Three different parallel implementa- tions of this tracker are presented, including multi-core CPU, GPU and ARM SoCs. On a commodity 2010 CPU, it can track 8 500 points in a 640 × 480 video at 150 Hz.
Fichier principal
Vignette du fichier
sdt_jrtip.pdf (5.61 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00868920 , version 1 (02-10-2013)

Identifiants

Citer

Matthieu Garrigues, Antoine Manzanera, Bernard Thierry. Video Extruder: a semi-dense point tracker for extracting beam of trajectories in real time. Journal of Real-Time Image Processing, 2014, pp.12. ⟨10.1007/s11554-014-0415-0⟩. ⟨hal-00868920⟩

Collections

ENSTA ENSTA_U2IS
137 Consultations
1296 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More