CNN-based temporal detection of motion saliency in videos - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue Pattern Recognition Letters Année : 2019

CNN-based temporal detection of motion saliency in videos

Résumé

The problem addressed in this paper appertains to the domain of motion saliency in videos. However this is a new problem since we aim to extract the temporal segments of the video where motion saliency is present. It turns out to be a frame-based classification problem. A frame will be classified as dynamically salient if it contains local motion departing from its context. Temporal motion saliency detection is relevant for applications where one needs to trigger alerts or to monitor dynamic behaviours from videos. It can also be viewed as a prerequisite before computing motion saliency maps. The proposed approach handles situations with a mobile camera. It involves two main stages consisting first in cancelling the global motion due to the camera movement, then in applying a deep learning classification framework. We have investigated two ways of implementing the first stage, based on image warping, and on residual flow respectively. Experiments on real videos demonstrate that we can obtain accurate classification in highly challenging situations.
Fichier principal
Vignette du fichier
CNN-based temporal detection of motion saliency in videos.pdf (6.68 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02345209 , version 1 (04-11-2019)

Identifiants

Citer

Léo Maczyta, Patrick Bouthemy, Olivier Le Meur. CNN-based temporal detection of motion saliency in videos. Pattern Recognition Letters, 2019, 128, pp.298-305. ⟨10.1016/j.patrec.2019.09.016⟩. ⟨hal-02345209⟩
133 Consultations
660 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More