krippendorffsalpha: An R Package for Measuring Agreement Using Krippendorff's Alpha Coefficient
Not on the map. Why?
Abstract (arXiv)
R package krippendorffsalpha provides tools for measuring agreement using Krippendorff's Alpha coefficient, a well-known nonparametric measure of agreement (also called inter-rater reliability and various other names). This article first develops Krippendorff's Alpha in a natural way, and situates Alpha among statistical procedures. Then the usage of package krippendorffsalpha is illustrated via analyses of two datasets, the latter of which was collected during an imaging study of hip cartilage. The package permits users to apply the Alpha methodology using built-in distance functions for the nominal, ordinal, interval, or ratio levels of measurement. User-defined distance functions are also supported. The fitting function can accommodate any number of units, any number of coders, and missingness. Bootstrap inference is supported, and the bootstrap computation can be carried out in parallel.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Mar 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 4; 2024: 0; 2025: 1; 2026: 2.
7 papers.
- 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 198
- 2023A semantics-driven methodology for high-quality image annotationcited by 6
- 2023Incremental Image Labeling via Iterative Refinementcited by 3
- 2023Video-Helpful Multimodal Machine Translationcited by 3
- 2025ReviewScore: Misinformed Peer Review Detection with Large Language Modelscited by 1
- 2026When Looks Do Not Lie: Discourse Structure Guided In-Context Learning for Faithful Diagram Generationcited by 0
- 2026Crowdsourcing of Real-world Image Annotation via Visual Propertiescited by 0
- 2026Crowdsourcing of Real-world Image Annotation via Visual Properties15 Apr 2026
- 2026When Looks Do Not Lie: Discourse Structure Guided In-Context Learning for Faithful Diagram Generation28 Jan 2026
- 2025ReviewScore: Misinformed Peer Review Detection with Large Language Models25 Sep 2025
- 2023Video-Helpful Multimodal Machine Translation31 Oct 2023
- 2023A semantics-driven methodology for high-quality image annotation26 Jul 2023
- 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets20 Jul 2023
- 2023Incremental Image Labeling via Iterative Refinement18 Apr 2023