# HEVAL: Yet Another Human Evaluation Metric

arXiv: https://arxiv.org/abs/1311.3961 · HTML: https://mlsanity.com/paper/1311.3961/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 Nov 2013.

## Built on by (most cited first, 1 of 1)

- [Trainable Reference-Based Evaluation Metric for Identifying Quality of English-Gujarati Machine Translation System](https://mlsanity.com/paper/2510.05113/) (2025)

## Abstract (arXiv)

Machine translation evaluation is a very important activity in machine translation development. Automatic evaluation metrics proposed in literature are inadequate as they require one or more human reference translations to compare them with output produced by machine translation. This does not always give accurate results as a text can have several different translations. Human evaluation metrics, on the other hand, lacks inter-annotator agreement and repeatability. In this paper we have proposed a new human evaluation metric which addresses these issues. Moreover this metric also provides solid grounds for making sound assumptions on the quality of the text produced by a machine translation.