Neural Network Based Data Fusion for Hand Pose Recognition with Multiple ToF Sensors
Résumé
We present a study on 3D based hand pose recognition us-ing a new generation of low-cost time-of-flight(ToF) sensors intended for outdoor use in automotive human-machine interaction. As signal quality is impaired compared to Kinect-type sensors, we study several ways to improve performance when a large number of gesture classes is involved. We investigate the performance of different 3D descriptors, as well as the fusion of two ToF sensor streams. By basing a data fusion strategy on the fact that multilayer perceptrons can produce normalized confidences in-dividually for each class, and similarly by designing information-theoretic online measures for assessing confidences of decisions, we show that ap-propriately chosen fusion strategies can improve overall performance to a very satisfactory level. Real-time capability is retained as the used 3D descriptors, the fusion strategy as well as the online confidence measures are computationally efficient.
Origine | Fichiers produits par l'(les) auteur(s) |
---|
Loading...