Unsupervised computation of salient motion maps from the interpretation of a frame-based classification network - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2021

Unsupervised computation of salient motion maps from the interpretation of a frame-based classification network

Abstract

We introduce a new paradigm for motion saliency (MS) which is an important issue in dynamic scene analysis. We formulate MS as a meta-task that can be instantiated for different tasks usually handled independently. To support this claim, we have addressed two important computer-vision problems with this MS paradigm: independent motion segmentation and anomalous motion detection in videos. We estimate MS from the interpretation of a frame-based saliency classification network with optical flow (OF) as input. Our paradigm can accommodate a given form of motion saliency by simply training the frame-based classification network on the corresponding task. Moreover, our MS estimation is unsupervised, as it does not require any ground-truth saliency maps for training. In addition, we have designed an original two-step network interpretation method, which supplies the binary salient motion segmentation. Finally, we recover the valued motion saliency map using a parametric flow inpainting method. Experimental results on real videos and comparison with existing methods assess the performance of our method.
Fichier principal
Vignette du fichier
BMVC2021_congres.pdf (4.48 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03469574 , version 1 (07-12-2021)

Identifiers

  • HAL Id : hal-03469574 , version 1

Cite

Etienne Meunier, Patrick Bouthemy. Unsupervised computation of salient motion maps from the interpretation of a frame-based classification network. BMVC 2021 - 32nd British Machine Vision Conference, Nov 2021, virtual conference, United Kingdom. pp.1-12. ⟨hal-03469574⟩

Collections

INRIA INRIA2
76 View
38 Download

Share

Gmail Facebook X LinkedIn More