Online temporal detection of daily-living human activities in long untrimmed video streams - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2018

Online temporal detection of daily-living human activities in long untrimmed video streams

Résumé

Many approaches were proposed to solve the problem of activity recognition in short clipped videos, which achieved impressive results with hand-crafted and deep features. However, it is not practical to have clipped videos in real life, where cameras provide continuous video streams in applications such as robotics, video surveillance, and smart-homes. Here comes the importance of activity detection to help recognizing and localizing each activity happening in long videos. Activity detection can be defined as the ability to localize starting and ending of each human activity happening in the video, in addition to recognizing each activity label. A more challenging category of human activities is the daily-living activities, such as eating, reading, cooking, etc, which have low inter-class variation and environment where actions are performed are similar. In this work we focus on solving the problem of detection of daily-living activities in untrimmed video streams. We introduce new online activity detection pipeline that utilizes single sliding window approach in a novel way; the classifier is trained with sub-parts of training activities, and an online frame-level early detection is done for sub-parts of long activities during detection. Finally, a greedy Markov model based post processing algorithm is applied to remove false detection and achieve better results. We test our approaches on two daily-living datasets, DAHLIA and GAADRD, outperforming state of the art results by more than 10%.
Fichier principal
Vignette du fichier
IPAS_2018.pdf (1.11 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01948387 , version 1 (07-12-2018)

Identifiants

  • HAL Id : hal-01948387 , version 1

Citer

Abhishek Goel, Abdelrahman Abubakr, Michal Koperski, Francois Bremond, Gianpiero Francesca. Online temporal detection of daily-living human activities in long untrimmed video streams. IEEE IPAS 2018, Dec 2018, Nice, France. ⟨hal-01948387⟩
176 Consultations
228 Téléchargements

Partager

More