Assessing the impact of automatic dependency annotation on the measurement of phraseological complexity in L2 Dutch
(2021) International Journal of Learner Corpus Research — Vol. 7, n° 1, p. 131-162 (2021)
Files
Rubin_2021.pdf
Open Access - Adobe PDF
- 743.9 KB
Details
- Authors
- Abstract
- The extraction of phraseological units operationalized in phraseological complexity measures (Paquot, 2019) relies on automatic dependency annotations, yet the suitability of annotation tools for learner language is often overlooked. In the present article, two Dutch dependency parsers, Alpino (van Noord, 2006) and Frog (van den Bosch et al., 2007), are evaluated for their performance in automatically annotating three types of dependency relations (verb + direct object, adjectival modifier, and adverbial modifier relations) across three proficiency levels of L2 Dutch. These observations then serve as the basis for an investigation into the impact of automatic dependency annotation on phraseological sophistication measures. Results indicate that both learner proficiency and the type of dependency relation function as moderating factors in parser performance. Phraseological complexity measures computed on the basis of both automatic and manual dependency annotations demonstrate moderate to high correlations, reflecting a moderate to low impact of automatic annotation on subsequent analyses.
- Affiliations
Vrije Universiteit Brussel Linguistics and Literary Studies
Citations
Rubin, R. (2021). Assessing the impact of automatic dependency annotation on the measurement of phraseological complexity in L2 Dutch. International Journal of Learner Corpus Research, 7(1), 131-162. https://doi.org/10.1075 (Original work published 2021)