PLOD: An Abbreviation Detection Dataset for Scientific Documents

Zilio, Leonardo;Saadany, Hadeel;Sharma, Prashant;Kanojia, Diptesh;Orăsan, Constantin
(2022) Proceedings of the Thirteenth International Conference on Language Resources and Evaluation (LREC 2022) — ISBN: [979-10-95546-38-2], 680-688, published

Files

2022.lrec-1.71.pdf
  • Open Access
  • Adobe PDF
  • 329.29 KB

Details

Authors
  • Author
  • Saadany, Hadeel
    Author
  • Sharma, Prashant
    Author
  • Kanojia, Diptesh
    Author
  • Orăsan, Constantin
    Author
Abstract
The detection and extraction of abbreviations from unstructured texts can help to improve the performance of Natural Language Processing tasks, such as machine translation and information retrieval. However, in terms of publicly available datasets, there is not enough data for training deep-neural-networks-based models to the point of generalising well over data. This paper presents PLOD, a large-scale dataset for abbreviation detection and extraction that contains 160k+ segments automatically annotated with abbreviations and their long forms. We performed manual validation over a set of instances and a complete automatic validation for this dataset. We then used it to generate several baseline models for detecting abbreviations and long forms. The best models achieved an F1-score of 0.92 for abbreviations and 0.89 for detecting their corresponding long forms. We release this dataset along with our code and all the models publicly in this Github Repository.
Affiliations

Citations

Zilio, L., Saadany, H., Sharma, P., Kanojia, D., & Orăsan, C. (2022). PLOD: An Abbreviation Detection Dataset for Scientific Documents. In Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis (ed.), Proceedings of the Thirteenth International Conference on Language Resources and Evaluation (LREC 2022) (pp. 680-688). European Language Resources Association (ELRA). https://doi.org/10.63317/5q86wscxc7xw