Joint Multi-object Detection and Segmentation from an Untrimmed Video - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2020

Joint Multi-object Detection and Segmentation from an Untrimmed Video

Le Wang
  • Fonction : Auteur
  • PersonId : 1033453
Qilin Zhang
  • Fonction : Auteur
Gang Hua
  • Fonction : Auteur

Résumé

In this paper, we present a novel method for jointly detecting and segmenting multiple objects from an untrimmed video. Unlike most existing video object segmentation methods that can only handle a trimmed video in which all video frames contain the target objects, we address a more practical and difficult problem, i.e., joint multi-object detection and segmentation from an untrimmed video where the target objects do not always appear per frame. In particular, our method consists of two modules, i.e., object decision module and object segmentation module. The object decision module is used to detect the objects and decide which target objects need to be separated out from video. As there are usually two or more target objects and they do not always appear in the whole video, we introduce the data association into object decision module to identify their correspondences among frames. The object segmentation module aims to separate the target objects identified by object decision module. In order to extensively evaluate the proposed method, we introduce a new dataset named UNVOSeg dataset, in which $$7.2\%$$ of the video frames do not contain objects. Experimental results on four datasets demonstrate that our method outperforms most of the state-of-the-art approaches.
Fichier principal
Vignette du fichier
497040_1_En_27_Chapter.pdf (13.34 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04050585 , version 1 (29-03-2023)

Licence

Identifiants

Citer

Xinling Liu, Le Wang, Qilin Zhang, Nanning Zheng, Gang Hua. Joint Multi-object Detection and Segmentation from an Untrimmed Video. 16th IFIP International Conference on Artificial Intelligence Applications and Innovations (AIAI), Jun 2020, Neos Marmaras, Greece. pp.317-329, ⟨10.1007/978-3-030-49161-1_27⟩. ⟨hal-04050585⟩
32 Consultations
17 Téléchargements

Altmetric

Partager

More