Files

Intercoder reliability in qualitative discourse analysis_26_06_30_21_35_21.pdf
  • Open Access
  • Adobe PDF
  • 416.35 KB
Download

Details

Authors
Abstract
Increasingly used in qualitative research, intercoder reliability (ICR) remains contested. Critics argue that it imports positivist assumptions and risks flattening the polysemic, context-dependent nature of meaning. This chapter contributes to these debates by examining how ICR can be operationalised in qualitative discourse analysis, drawing on the annotation of ‘populism’ and its derivatives in Belgian, French, and Spanish public discourse as an illustrative case. We identify three challenges specific to sociopolitical keywords: the need for context-rich segmentation, the interpretive work required to reconstruct implicit meanings, and the difficulty of assessing agreement in multi-label and open-ended coding. We then present a reliability protocol tailored to a heterogeneous coding grid that includes closed single-choice and multi-choice variables, alongside open and mixed formats. The initial ICR assessment reveals a consistent pattern: strong convergence on formal, directly observable descriptors, and weaker convergence on inferential or highly polysemic dimensions. Ultimately, the chapter shows that ICR can be integrated into discourse analysis as both a device for coordinating interpretive coding and an analytic lever, making coding decisions traceable, supporting iterative codebook refinement, and identifying zones of semantic density where disagreement is theoretically meaningful.
Affiliations

Citations

  • APA
  • Chicago
  • FWB

Rondiat, C., Niessen, C., De Cock, B., & Hambye, P. (2026). Intercoder reliability in qualitative discourse analysis. In Laetitia Aulit, Anaïs Augé, Barbara De Cock, Min Reuchamps, Sandrine Roginsky, Coline Rondiat (ed.), An Interdisciplinary Approach to Discourse on Populism: Tracking the Uses of ‘Populism’ in Media and Political Discourse (pp. 47-69). Routledge. https://doi.org/10.4324/9781003610489-5