Hierarchical-Task Reservoir for Anytime POS Tagging from Continuous Speech - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year :

Hierarchical-Task Reservoir for Anytime POS Tagging from Continuous Speech

Luca Pedrelli
  • Function : Author
Xavier Hinaut


We propose a novel architecture called Hierarchical-Task Reservoir (HTR) suitable for real-time sentence parsing from continuous speech. Accordingly, we introduce a novel task that consists in performing anytime Part-of-Speech (POS) tagging from continuous speech. This HTR architecture is designed to address three sub-tasks (phone, word and POS tag estimation) with increasing levels of abstraction. These tasks are performed by the consecutive layers of the HTR architecture. Interestingly, the qualitative results show that the learning of sub-tasks enforces low frequency dynamics (i.e. with longer timescales) in the more abstract layers. We compared HTR with a baseline hierarchical reservoir architecture (in which each layer is an ESN that addresses the same POS tag estimation). Moreover, we also performed a thorough experimental comparison with several architectural variants. Finally, the HTR obtained the best performance in all experimental comparisons. Overall, the proposed approach will be a useful tool for further studies regarding both the modeling of language comprehension in a neuroscience context and for real-time implementations in Human-Robot Interaction (HRI) context.
Fichier principal
Vignette du fichier
PedrelliHinaut2020_IJCNN.pdf (1010.84 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02594495 , version 1 (15-05-2020)


  • HAL Id : hal-02594495 , version 1


Luca Pedrelli, Xavier Hinaut. Hierarchical-Task Reservoir for Anytime POS Tagging from Continuous Speech. 2020 International Joint Conference on Neural Networks (IJCNN 2020), Jul 2020, Glasgow, Scotland, United Kingdom. ⟨hal-02594495⟩
122 View
159 Download


Gmail Facebook Twitter LinkedIn More