Gaze Prediction using Machine Learning for Dynamic Stereo Manipulation in Games - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2016

Gaze Prediction using Machine Learning for Dynamic Stereo Manipulation in Games

Abstract

Comfortable, high-quality 3D stereo viewing is becoming a requirement for interactive applications today. Previous research shows that manipulating disparity can alleviate some of the discomfort caused by 3D stereo, but it is best to do this locally, around the object the user is gazing at. The main challenge is thus to develop a gaze predictor in the demanding context of real-time, heavily task-oriented applications such as games. Our key observation is that player actions are highly correlated with the present state of a game, encoded by game variables. Based on this, we train a classifier to learn these correlations using an eye-tracker which provides the ground-truth object being looked at. The classifier is used at runtime to predict object category -- and thus gaze -- during game play, based on the current state of game variables. We use this prediction to propose a dynamic disparity manipulation method, which provides rich and comfortable depth. We evaluate the quality of our gaze predictor numerically and experimentally, showing that it predicts gaze more accurately than previous approaches. A subjective rating study demonstrates that our localized disparity manipulation is preferred over previous methods.
Fichier principal
Vignette du fichier
percsense.pdf (33.12 Mo) Télécharger le fichier
Vignette du fichier
comparisonStereo.jpg (595.85 Ko) Télécharger le fichier
supplemental.pdf (138.02 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Format : Figure, Image
Origin : Files produced by the author(s)
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01290273 , version 1 (21-03-2016)

Identifiers

  • HAL Id : hal-01290273 , version 1

Cite

George Alex Koulieris, George Drettakis, Douglas Cunningham, Katerina Mania. Gaze Prediction using Machine Learning for Dynamic Stereo Manipulation in Games. IEEE Virtual Reality, Mar 2016, Greenville, United States. ⟨hal-01290273⟩
132 View
199 Download

Share

Gmail Facebook X LinkedIn More