(2016) Proceedings of the 12th International Conference on Computational Processing of the Portuguese Language — ISBN: [978-3-319-41551-2], 333-339, published
The lack of availability of gold standards for evaluation of distributional thesauri is a stumbling block that prevents a direct comparison of alternative approaches in a uniform way. Here we present B 2 SG, a TOEFL-like task for Portuguese that contains 2,875 tests with semantic relations (synonyms, antonyms and hypernyms) for nouns and verbs. The resource is validated by comparing it with lexical resources and by human judgment. The resource was used for evaluating two dis-tributional thesauri: one built from lemmata and the other from surface forms. The evaluation of thesauri demonstrated that the use of lemmata is slightly more accurate than the use surface forms for building distri-butional thesauri. B 2 SG is readily available for download (http://www. inf.ufrgs.br/pln/resource/B2SG.zip).
Wilkens, R., Zilio, L., Ferreira, E., & Villavicencio, A. (2016). The Portuguese B2SG: A Semantic Test for Distributional Thesaurus. In João Silva, Ricardo Ribeiro, Paulo Quaresma, André Adami, António Branco (ed.), Proceedings of the 12th International Conference on Computational Processing of the Portuguese Language (pp. 333-339). Springer International Publishing. https://doi.org/10.1007/978-3-319-41552-9_33