Tracking-by-Synthesis Using Point Features and Pyramidal Blurring - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2011

Tracking-by-Synthesis Using Point Features and Pyramidal Blurring

Gilles Simon


Tracking-by-synthesis is a promising method for markerless vision-based camera tracking, particularly suitable for Augmented Reality applications. In particular, it is drift-free, viewpoint invariant and easy-to-combine with physical sensors such as GPS and inertial sensors. While edge features have been used succesfully within the tracking-by-synthesis framework, point features have, to our knowledge, still never been used. We believe that this is due to the fact that real-time corner detectors are generally weakly repeatable between a camera image and a rendered texture. In this paper, we compare the repeatability of commonly used FAST, Harris and SURF interest point detectors across view synthesis. We show that adding depth blur to the rendered texture can drastically improve the repeatability of FAST and Harris corner detectors (up to 100% in our experiments), which can be very helpful, e.g., to make tracking-by-synthesis running on mobile phones. We propose a method for simulating depth blur on the rendered images using a pre-calibrated depth response curve. In order to fulfil the performance requirements, a pyramidal approach is used based on the well-known MIP mapping technique. We also propose an original method for calibrating the depth response curve, which is suitable for any kind of focus lenses and comes for free in terms of programming effort, once the tracking-by-synthesis algorithm has been implemented.


Other [cs.OH]
Fichier principal
Vignette du fichier
simon-final.pdf (1.08 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

inria-00614867 , version 1 (03-01-2012)


  • HAL Id : inria-00614867 , version 1


Gilles Simon. Tracking-by-Synthesis Using Point Features and Pyramidal Blurring. 10th IEEE International Symposium on Mixed and Augmented Reality - ISMAR 2011, Oct 2011, Basel, Switzerland. ⟨inria-00614867⟩
239 View
496 Download


Gmail Facebook X LinkedIn More