What can we expect from a V1-MT feedforward architecture for optical flow estimation? - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Signal Processing: Image Communication Year : 2015

What can we expect from a V1-MT feedforward architecture for optical flow estimation?

Abstract

Motion estimation has been studied extensively in neuroscience in the last two decades. Even though there has been some early interaction between the biological and computer vision communities at a modelling level, comparatively little work has been done on the examination or extension of the biological models in terms of their engineering efficacy on modern optical flow estimation datasets. An essential contribution of this paper is to show how a neural model can be enriched to deal with real sequences. We start from a classical V1-MT feedforward architecture. We model V1 cells by motion energy (based on spatio-temporal filtering), and MT pattern cells (by pooling V1 cell responses). The efficacy of this architecture and its inherent limitations in the case of real videos are not known. To answer this question, we propose a velocity space sampling of MT neurons (using a decoding scheme to obtain the local velocity from their activity) coupled with a multi-scale approach. After this, we explore the performance of our model on the Middlebury dataset. To the best of our knowledge, this is the only neural model in this dataset. The results are promising and suggest several possible improvements, in particular to better deal with discontinuities. Overall, this work provides a baseline for future developments of bio-inspired scalable computer vision algorithms and the code is publicly available to encourage research in this direction. & 2015 Published by Elsevier B.V.
Fichier principal
Vignette du fichier
2015-solari-image-communication.pdf (8.95 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01215519 , version 1 (20-10-2015)

Identifiers

Cite

Fabio Solari, Manuela Chessa, N. V. Kartheek Medathati, Pierre Kornprobst. What can we expect from a V1-MT feedforward architecture for optical flow estimation?. Signal Processing: Image Communication, 2015, ⟨10.1016/j.image.2015.04.006⟩. ⟨hal-01215519⟩
243 View
205 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More