Conference Papers Year : 2012

The Alpage Architecture at the SANCL 2012 Shared Task: Robust Pre-Processing and Lexical Bridging for User-Generated Content Parsing

Abstract

We describe the architecture we set up during the SANCL shared task for parsing user-generated texts, that deviate in various ways from linguistic conventions used in available training treebanks. This architecture focuses in coping with such a divergence. It relies on the PCFG-LA framework (Petrov and Klein, 2007), as implemented by Attia et al. (2010). We explore several techniques to augment robustness: (i) a lexical bridge technique (Candito et al., 2011) that uses unsupervised word clustering (Koo et al., 2008); (ii) a special instanciation of self-training aimed at coping with POS tags unknown to the training set; (iii) the wrapping of a POS tagger with rule-based processing for dealing with recurrent non-standard tokens; and (iv) the guiding of out-of-domain parsing with predicted part-of-speech tags for unknown words and unknown (word, tag) pairs. Our systems ranked second and third out of eight in the constituency parsing track of the SANCL competition.
Fichier principal
Vignette du fichier
SANCL-Alpage.pdf (53.88 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-00703124 , version 1 (31-05-2012)
hal-00703124 , version 2 (01-06-2012)

Identifiers

  • HAL Id : hal-00703124 , version 2

Cite

Djamé Seddah, Benoît Sagot, Marie Candito. The Alpage Architecture at the SANCL 2012 Shared Task: Robust Pre-Processing and Lexical Bridging for User-Generated Content Parsing. SANCL 2012 - First Workshop on Syntactic Analysis of Non-Canonical Language an NAACL-HLT'12 workshop, Jun 2012, Montréal, Canada. ⟨hal-00703124v2⟩
241 View
283 Download

Share

More