# HEDS 3.0: The Human Evaluation Data Sheet Version 3.0

arXiv: https://arxiv.org/abs/2412.07940 · HTML: https://mlsanity.com/paper/2412.07940/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 4 of its 67 references that are in the map.
- First posted on arXiv 10 Dec 2024.

## Builds on (most cited first, 4 of 4)

- [Datasheets for Datasets](https://mlsanity.com/paper/1803.09010/) (2018)
- [Model Cards for Model Reporting](https://mlsanity.com/paper/1810.03993/) (2018)
- [The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics](https://mlsanity.com/paper/2102.01672/) (2021)
- [The Human Evaluation Datasheet 1.0: A Template for Recording Details of Human Evaluation Experiments in NLP](https://mlsanity.com/paper/2103.09710/) (2021)

## Abstract (arXiv)

This paper presents version 3.0 of the Human Evaluation Datasheet (HEDS). This update is the result of our experience using HEDS in the context of numerous recent human evaluation experiments, including reproduction studies, and of feedback received. Our main overall goal was to improve clarity, and to enable users to complete the datasheet more consistently and comparably. The HEDS 3.0 package consists of the digital data sheet, documentation, and code for exporting completed data sheets as latex files, all available from the HEDS GitHub.