Exploring the power of generative artificial intelligence for automatic term extraction from small samples

De Pourcq, Lena;Grégoire, Marie;Zilio, Leonardo
(2025) Electronic lexicography in the 21st century. Proceedings of the eLex 2025 conference. Intelligent Lexicography — Vol. 1, p. 113-135 (2025)

Files

eLex2025-08-De_Pourcq_etal.pdf
  • Open Access
  • Adobe PDF
  • 1.17 MB
Download

Details

Authors
Abstract
This study explores the use of several chatbots based on recent generative large language models for automatic term extraction (ATE) from smaller text samples. The samples were selected from three domains: board games, ice hockey, and kitesurfing; and they cover three languages: English, French, and Portuguese. We used four prompting strategies: zero shot, one shot, few shots, and few shots with context. A single prompt with placeholders for language, domain and examples (when available) was used for all settings, and, in the case of French and Portuguese, we tested the ATE prompt in English and in the respective language. Results were calculated in terms of f-measure, and we further tested the best models with five consecutive runs to calculate a mean f-measure and a standard deviation. No clear best system was verified for the task. Each of the domains and languages had different best systems. In terms of prompting strategy, more information did not always lead to better results, as zero-shot and one-shot attempts had the best results in several scenarios. The main contribution of the study is an overview of the ATE capacity of several chatbot systems across multiple scenarios.
Affiliations

Citations

  • APA
  • Chicago
  • FWB

De Pourcq, L., Grégoire, M., & Zilio, L. (2025). Exploring the power of generative artificial intelligence for automatic term extraction from small samples. Electronic lexicography in the 21st century. Proceedings of the eLex 2025 conference. Intelligent Lexicography, 1, 113-135. https://hdl.handle.net/2078.5/276996 (Original work published 2025)