Multiword Expression Identification with Tree Substitution Grammars: A Parsing tour de force with French

Green, Spence;de Marneffe, Marie-Catherine;Bauer, John;Manning, Christopher D.
(2011) Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing (2011)

Files

D11-1067.pdf
  • Open Access
  • Adobe PDF
  • 374.22 KB
Download

Details

Authors
Abstract
Multiword expressions (MWE), a known nuisance for both linguistics and NLP, blur the lines between syntax and semantics. Previous work on MWE identification has relied primarily on surface statistics, which perform poorly for longer MWEs and cannot model discontinuous expressions. To address these problems, we show that even the simplest parsing models can effectively identify MWEs of arbitrary length, and that Tree Substitution Grammars achieve the best results. Our experiments show a 36.4% F1 absolute improvement for French over an n-gram surface statistics baseline, currently the predominant method for MWE identification. Our models are useful for several NLP tasks in which MWE pre-grouping has improved accuracy.
Affiliations

Citations

  • APA
  • Chicago
  • FWB

Green, S., de Marneffe, M.-C., Bauer, J., & Manning, C. D. (2011). Multiword Expression Identification with Tree Substitution Grammars: A Parsing tour de force with French. Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing (EMNLP 2011). Published. Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing. https://hdl.handle.net/2078.5/216269 (Original work published 2011)