Research on a Smart Input Device Using Multimodal Bio-signal Interface
Résumé
This paper presents a smart input device based on multimodal analysis methods using human bio-signals. The core of the smart input device is software modules, which consist of an intelligent driving function and an analysis processing function for bio-signals. The smart input device utilizes a multimodal interface that analyzes and recognizes human bio-signal patterns. The multimodal analysis system can recognize a user’s emotional and stress status by analyzing an electrocardiogram (ECG), and it can determine the user’s level of concentration from electroencephalogram (EEG) patterns. To analyze the concentration, stress, and emotional status of the user, the EEG rendering system and ECG analysis system use five signal values, i.e., MID_BETA, THETA, ALPHA, DELTA, GAMMA, and the P, Q, R, S and T waves. A reformation of SVM and a clustering algorithm were applied to the user’s EEG and ECG signal patterns for body context recognition. In our experiment, the on/ off status of the user’s stress status controls the difficulties of the game, such as the selecting the type of race course or the number of obstacles. In addition, the speed of the car can be controlled depending on the concentration or non-concentration status of the user. The stress status of the user was predicted with an accuracy of 83.2% by the K-means algorithm, and the concentration status was predicted with an accuracy of 71.85% by the SVM algorithm. We showed that a bio-signal interface is quite useful and feasible for new games.
Domaines
Informatique [cs]Origine | Fichiers produits par l'(les) auteur(s) |
---|
Loading...