Action Recognition based on a mixture of RGB and Depth based skeleton - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2017

Action Recognition based on a mixture of RGB and Depth based skeleton

Srijan Das
  • Fonction : Auteur
  • PersonId : 21855
  • IdHAL : srijan-das
Michal Koperski
Gianpiero Francesca
  • Fonction : Auteur
  • PersonId : 1023188

Résumé

In this paper, we study how different skeleton extraction methods affect the performance of action recognition. As shown in previous work skeleton information can be exploited for action recognition. Nevertheless, skeleton detection problem is already hard and very often it is difficult to obtain reliable skeleton information from videos. In this paper , we compare two skeleton detection methods: the depth-map based method used with Kinect camera and RGB based method that uses Deep Convolutional Neural Networks. In order to balance the pros and cons of mentioned skeleton detection methods w.r.t. action recognition task, we propose a fusion of classifiers trained based on each skeleton detection method. Such fusion lead to performance improvement. We validate our approach on CAD-60 and MSRDailyActiv-ity3D, achieving state-of-the-art results.
Fichier principal
Vignette du fichier
fusing-rgb-depth.pdf (289.99 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01639504 , version 1 (21-11-2017)

Identifiants

  • HAL Id : hal-01639504 , version 1

Citer

Srijan Das, Michal Koperski, François Bremond, Gianpiero Francesca. Action Recognition based on a mixture of RGB and Depth based skeleton. AVSS 2017 - 14-th IEEE International Conference on Advanced Video and Signal-Based Surveillance, Aug 2017, Lecce, Italy. ⟨hal-01639504⟩
133 Consultations
435 Téléchargements

Partager

Gmail Facebook X LinkedIn More