Human Trajectory Forecasting in 3D Environments: Navigating Complexity under Low Vision - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Human Trajectory Forecasting in 3D Environments: Navigating Complexity under Low Vision

Résumé

This work tackles the challenge of predicting human trajectories while carrying out complex tasks in contextually-rich virtual environments. We evaluate the CREATIVE3D multimodal dataset on human interaction and navigation in 3D virtual reality (VR). In the dataset, navigating traffic crossings with simulated visual impairments are used as an example of complex or unpredictable situations. We establish evaluations for a base multi-layer perceptron (MLP) and two state-of-the-art models: TRACK (RNN) and GIMO (transformer), on tasks with varying levels of complexity and visual impairment conditions. Our findings indicate that a model trained on normal visual conditions and simple tasks does not generalize on test data with complex interactions and simulated visual impairments, despite including 3D scene context and user gaze. In comparison, a model trained on diverse visual and task conditions is more robust, with up to 84% decrease in positional error and 9% in orientation error, but with the trade-off of lower accuracy for simpler tasks. We believe this work can benefit real-world applications such as autonomous driving, and enable context-aware computing for diverse scenarios and populations.
Fichier principal
Vignette du fichier
MMVE2024_workshop_final.pdf (7.35 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04569869 , version 1 (06-05-2024)

Licence

Paternité

Identifiants

Citer

Franz Franco Gallo, Hui-Yin Wu, Lucile Sassatelli. Human Trajectory Forecasting in 3D Environments: Navigating Complexity under Low Vision. MMVE 2024 - ACM Multimedia Systems Workshop on IMmersive Mixed and Virtual Environment Systems, Apr 2024, Bari, Italy. pp.57-63, ⟨10.1145/3652212.3652223⟩. ⟨hal-04569869⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More