The Portuguese B2SG: A Semantic Test for Distributional Thesaurus

Wilkens, Rodrigo;Zilio, Leonardo;Ferreira, Eduardo;Villavicencio, Aline
(2016) Proceedings of the 12th International Conference on Computational Processing of the Portuguese Language — ISBN: [978-3-319-41551-2], 333-339, published

Files

2016 - PROPOR 2016 - The Portuguese B2SG.pdf
  • Open Access
  • Adobe PDF
  • 140.48 KB

Details

Authors
  • Wilkens, Rodrigo
    Author
  • Author
  • Ferreira, Eduardo
    Author
  • Villavicencio, Aline
    Author
Abstract
The lack of availability of gold standards for evaluation of distributional thesauri is a stumbling block that prevents a direct comparison of alternative approaches in a uniform way. Here we present B 2 SG, a TOEFL-like task for Portuguese that contains 2,875 tests with semantic relations (synonyms, antonyms and hypernyms) for nouns and verbs. The resource is validated by comparing it with lexical resources and by human judgment. The resource was used for evaluating two dis-tributional thesauri: one built from lemmata and the other from surface forms. The evaluation of thesauri demonstrated that the use of lemmata is slightly more accurate than the use surface forms for building distri-butional thesauri. B 2 SG is readily available for download (http://www. inf.ufrgs.br/pln/resource/B2SG.zip).
Affiliations

Citations

Wilkens, R., Zilio, L., Ferreira, E., & Villavicencio, A. (2016). The Portuguese B2SG: A Semantic Test for Distributional Thesaurus. In João Silva, Ricardo Ribeiro, Paulo Quaresma, André Adami, António Branco (ed.), Proceedings of the 12th International Conference on Computational Processing of the Portuguese Language (pp. 333-339). Springer International Publishing. https://doi.org/10.1007/978-3-319-41552-9_33