mlsanityData to 7 Oct 2026

Absolute Evaluation Measures for Machine Learning: A Survey

arXiv 2507.03392 ↗First posted 4 Jul 2025cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Machine Learning is a diverse field applied across various domains such as computer science, social sciences, medicine, chemistry, and finance. This diversity results in varied evaluation approaches, making it difficult to compare models effectively. Absolute evaluation measures offer a practical solution by assessing a model's performance on a fixed scale, independent of reference models and data ranges, enabling explicit comparisons. However, many commonly used measures are not universally applicable, leading to a lack of comprehensive guidance on their appropriate use. This survey addresses this gap by providing an overview of absolute evaluation metrics in ML, organized by the type of learning problem. While classification metrics have been extensively studied, this work also covers clustering, regression, and ranking metrics. By grouping these measures according to the specific ML challenges they address, this survey aims to equip practitioners with the tools necessary to select appropriate metrics for their models. The provided overview thus improves individual model evaluation and facilitates meaningful comparisons across different models and applications.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 18 of its 76 references that are in the map. First posted on arXiv 4 Jul 2025.

Builds on

18 of 76 references.

References · 18

  1. 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 420
  2. 2020A Survey of Evaluation Metrics Used for NLG Systemscited by 164
  3. 2017Learning how to Active Learn: A Deep Reinforcement Learning Approachcited by 79
  4. 2022Towards a Guideline for Evaluation Metrics in Medical Image Segmentationcited by 58
  5. 2022On Evaluation Metrics for Graph Generative Modelscited by 44
  6. 2020A Survey on Machine Reading Comprehension: Tasks, Evaluation Metrics and Benchmark Datasetscited by 40
  7. 2019Metrics for Graph Comparison: A Practitioner's Guidecited by 37
  8. 2022A Survey of Explainable Graph Neural Networks: Taxonomy and Evaluation Metricscited by 26
  9. 2021Evaluating the Evaluation Metrics for Style Transfer: A Case Study in Multilingual Formality Transfercited by 23
  10. 2019Evaluation Metrics for Unsupervised Learning Algorithmscited by 16
  11. 2020Insights into Performance Fitness and Error Metrics for Machine Learningcited by 12
  12. 2021Notes on the H-measure of classifier performancecited by 7
6 more
  1. 2022A Unified Study of Machine Learning Explanation Evaluation Metricscited by 6
  2. 2019Jaccard/Tanimoto similarity test and estimation methodscited by 4
  3. 2022Single Object Tracking: A Survey of Methods, Datasets, and Evaluation Metricscited by 4
  4. 2022How to Find Strong Summary Coherence Measures? A Toolbox and a Comparative Study for Summary Coherence Measure Evaluationcited by 4
  5. 2021Survey of Imbalanced Data Methodologiescited by 2
  6. 2022Empirical study of Machine Learning Classifier Evaluation Metrics behavior in Massively Imbalanced and Noisy datacited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.