Research on a Smart Input Device Using Multimodal Bio-signal Interface - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2012

Research on a Smart Input Device Using Multimodal Bio-signal Interface

Hyunju Lee
  • Function : Author
  • PersonId : 1011260
Taehyun Kim
  • Function : Author
  • PersonId : 1011261
Dongkyoo Shin
  • Function : Author
  • PersonId : 1011262
Heewon Park
  • Function : Author
  • PersonId : 1011263
Soohan Kim
  • Function : Author
  • PersonId : 1011264
Dongil Shin
  • Function : Author
  • PersonId : 1011265


This paper presents a smart input device based on multimodal analysis methods using human bio-signals. The core of the smart input device is software modules, which consist of an intelligent driving function and an analysis processing function for bio-signals. The smart input device utilizes a multimodal interface that analyzes and recognizes human bio-signal patterns. The multimodal analysis system can recognize a user’s emotional and stress status by analyzing an electrocardiogram (ECG), and it can determine the user’s level of concentration from electroencephalogram (EEG) patterns. To analyze the concentration, stress, and emotional status of the user, the EEG rendering system and ECG analysis system use five signal values, i.e., MID_BETA, THETA, ALPHA, DELTA, GAMMA, and the P, Q, R, S and T waves. A reformation of SVM and a clustering algorithm were applied to the user’s EEG and ECG signal patterns for body context recognition. In our experiment, the on/ off status of the user’s stress status controls the difficulties of the game, such as the selecting the type of race course or the number of obstacles. In addition, the speed of the car can be controlled depending on the concentration or non-concentration status of the user. The stress status of the user was predicted with an accuracy of 83.2% by the K-means algorithm, and the concentration status was predicted with an accuracy of 71.85% by the SVM algorithm. We showed that a bio-signal interface is quite useful and feasible for new games.
Fichier principal
Vignette du fichier
978-3-642-35606-3_67_Chapter.pdf (912.7 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01551346 , version 1 (30-06-2017)





Hyunju Lee, Taehyun Kim, Dongkyoo Shin, Heewon Park, Soohan Kim, et al.. Research on a Smart Input Device Using Multimodal Bio-signal Interface. 9th International Conference on Network and Parallel Computing (NPC), Sep 2012, Gwangju, South Korea. pp.565-574, ⟨10.1007/978-3-642-35606-3_67⟩. ⟨hal-01551346⟩
49 View
68 Download



Gmail Facebook X LinkedIn More