Reinforcement Learning and Dimensionality Reduction: a model in Computational Neuroscience - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2011

Reinforcement Learning and Dimensionality Reduction: a model in Computational Neuroscience

Résumé

Basal Ganglia, a group of sub-cortical neuronal nuclei in the brain, are commonly described as the neuronal substratum to Reinforcement Learning. Since the seminal work by Schultz [1], a huge amount of work has been done to deepen that analogy, from functional and anatomic points of view. Nevertheless, a noteworthy architectural hint has been hardly explored: the outstanding reduction of dimensionality from the input to the output of the basal ganglia. Bar-Gad et al. [2] have suggested that this transformation could correspond to a Principal Component Analysis but did not explore the full functional consequences of this hypothesis. In this paper, we propose to study this mechanism within a model more realistic from a computational neuroscience point of view. Particularly, we show its feasibility when the loop is closed, in the framework of Action Selection.
Fichier principal
Vignette du fichier
ShahAlexandreIJCNN11.pdf (302.53 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

inria-00586245 , version 1 (15-04-2011)

Identifiants

  • HAL Id : inria-00586245 , version 1

Citer

Nishal Shah, Frédéric Alexandre. Reinforcement Learning and Dimensionality Reduction: a model in Computational Neuroscience. International Joint Conference on Neural Networks IJCNN 2011, Jul 2011, San Jose, CA, United States. ⟨inria-00586245⟩
149 Consultations
760 Téléchargements

Partager

More