Reward Function Design for Crowd Simulation via Reinforcement Learning - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Reward Function Design for Crowd Simulation via Reinforcement Learning

Résumé

Crowd simulation is important for video-games design, since it enables to populate virtual worlds with autonomous avatars that navigate in a human-like manner. Reinforcement learning has shown great potential in simulating virtual crowds, but the design of the reward function is critical to achieving effective and efficient results. In this work, we explore the design of reward functions for reinforcement learning-based crowd simulation. We provide theoretical insights on the validity of certain reward functions according to their analytical properties, and evaluate them empirically using a range of scenarios, using the energy efficiency as the metric. Our experiments show that directly minimizing the energy usage is a viable strategy as long as it is paired with an appropriately scaled guiding potential, and enable us to study the impact of the different reward components on the behavior of the simulated crowd. Our findings can inform the development of new crowd simulation techniques, and contribute to the wider study of human-like navigation.

Dates et versions

hal-04377287 , version 1 (07-01-2024)

Licence

Paternité

Identifiants

Citer

Ariel Kwiatkowski, Vicky Kalogeiton, Julien Pettré, Marie-Paule Cani. Reward Function Design for Crowd Simulation via Reinforcement Learning. MIG 2023 - 16th ACM SIGGRAPH Conference on Motion, Interaction and Games, Nov 2023, Rennes, France. pp.1-11, ⟨10.1145/3623264.3624452⟩. ⟨hal-04377287⟩
30 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More