Modeling the formation of social conventions from embodied real-time interactions - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles PLoS ONE Year : 2020

Modeling the formation of social conventions from embodied real-time interactions

Abstract

What is the role of real-time controland learning in the formation of social conventions? To answer this question, we propose a computational model that matches human behavioral data in a social decision-making game that was analyzed both in discrete-time and continuous-time setups. Furthermore unlike previous approaches,our model takes into account the role of sensorimotor control loops in embodied decision-making scenarios.For this purpose, we introduce the Control-based Reinforcement Learning (CRL) model. CRL is grounded in the Distributed Adaptive Control (DAC) theory of mind and brain, where low-level sensorimotor control is modulated through perceptual and behavioral learningin a layered structure. CRL follows these principles by implementing a feedback control loop handling the agent’s reactive behaviors(pre-wired reflexes), along with an Adaptive Layer that uses reinforcement learning,to maximize long-term reward.We test our model in a multi-agent game-theoretic task in which coordination must be achieved to find an optimalsolution.We show that CRL is able to reach human-level performance on standard game-theoreticmetrics such as efficiency in acquiring rewards and fairness in reward distribution.

Dates and versions

hal-03050740 , version 1 (10-12-2020)

Identifiers

Cite

Ismael Freire, Clément Moulin-Frier, Marti Sanchez-Fibla, Xerxes Arsiwalla, Paul Verschure. Modeling the formation of social conventions from embodied real-time interactions. PLoS ONE, 2020, 15 (6), pp.e0234434. ⟨10.1371/journal.pone.0234434⟩. ⟨hal-03050740⟩
39 View
0 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More