SOMMA: Cortically Inspired Paradigms for Multimodal Processing - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2013

SOMMA: Cortically Inspired Paradigms for Multimodal Processing

Mathieu Lefort
Yann Boniface
Bernard Girau

Résumé

SOMMA (Self Organizing Maps for Multimodal Association) consists on cortically inspired paradigms for multi-modal data processing. SOMMA defines generic cortical maps - one for each modality - composed of 3-layers cortical columns. Each column learns a discrimination to a stimulus of the input flow with the BCMu learning rule [26]. These discriminations are self-organized in each map thanks to the coupling with neural fields used as a neighborhood function. Learning and computation in each map is influenced by other modalities thanks to bidirectional topographic connections between all maps. This multimodal influence drives a joint self-organization of maps and multimodal perceptions of stimuli. This work takes place after the design of a self-organizing map and of a modulation mechanism for influencing its self-organization oriented towards a multimodal purpose. In this paper, we introduce a way to connect these self-organizing maps to obtain a multimap multimodal processing, completing our previous work. We also give an overview of the architectural and functional properties of the resulting paradigm SOMMA.

Domaines

Neurosciences
Fichier principal
Vignette du fichier
finalarticle.pdf (1.73 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00859986 , version 1 (09-09-2013)

Identifiants

  • HAL Id : hal-00859986 , version 1

Citer

Mathieu Lefort, Yann Boniface, Bernard Girau. SOMMA: Cortically Inspired Paradigms for Multimodal Processing. International Joint Conference on Neural Networks, Aug 2013, Dallas, United States. ⟨hal-00859986⟩
196 Consultations
241 Téléchargements

Partager

More