Action Recognition based on a mixture of RGB and Depth based skeleton - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year :

Action Recognition based on a mixture of RGB and Depth based skeleton

Srijan Das
  • Function : Author
  • PersonId : 21855
  • IdHAL : srijan-das
Michal Koperski
Gianpiero Francesca
  • Function : Author
  • PersonId : 1023188

Abstract

In this paper, we study how different skeleton extraction methods affect the performance of action recognition. As shown in previous work skeleton information can be exploited for action recognition. Nevertheless, skeleton detection problem is already hard and very often it is difficult to obtain reliable skeleton information from videos. In this paper , we compare two skeleton detection methods: the depth-map based method used with Kinect camera and RGB based method that uses Deep Convolutional Neural Networks. In order to balance the pros and cons of mentioned skeleton detection methods w.r.t. action recognition task, we propose a fusion of classifiers trained based on each skeleton detection method. Such fusion lead to performance improvement. We validate our approach on CAD-60 and MSRDailyActiv-ity3D, achieving state-of-the-art results.
Fichier principal
Vignette du fichier
fusing-rgb-depth.pdf (289.99 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01639504 , version 1 (21-11-2017)

Identifiers

  • HAL Id : hal-01639504 , version 1

Cite

Srijan Das, Michal Koperski, François Bremond, Gianpiero Francesca. Action Recognition based on a mixture of RGB and Depth based skeleton. AVSS 2017 - 14-th IEEE International Conference on Advanced Video and Signal-Based Surveillance, Aug 2017, Lecce, Italy. ⟨hal-01639504⟩
126 View
402 Download

Share

Gmail Facebook Twitter LinkedIn More