# Performance Metrics (Error Measures) in Machine Learning Regression, Forecasting and Prognostics: Properties and Typology

arXiv: https://arxiv.org/abs/1809.03006 · HTML: https://mlsanity.com/paper/1809.03006/

## Key facts

- Cited by 35 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 9 Sep 2018.

## Built on by (most cited first, 30 of 35)

- [Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learning](https://mlsanity.com/paper/2202.05338/) (2022)
- [Predicting the Mechanical Properties of Biopolymer Gels Using Neural Networks Trained on Discrete Fiber Network Data](https://mlsanity.com/paper/2101.11712/) (2021)
- [Intra-domain and cross-domain transfer learning for time series data -- How transferable are the features?](https://mlsanity.com/paper/2201.04449/) (2022)
- [Lost in Serialization: Invariance and Generalization of LLM Graph Reasoners](https://mlsanity.com/paper/2511.10234/) (2025)
- [How many samples are needed to train a deep neural network?](https://mlsanity.com/paper/2405.16696/) (2024)
- [A Look at the Evaluation Setup of the M5 Forecasting Competition](https://mlsanity.com/paper/2108.03588/) (2021)
- [A Comparative Study of Sampling Methods with Cross-Validation in the FedHome Framework](https://mlsanity.com/paper/2406.01950/) (2024)
- [Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach](https://mlsanity.com/paper/2410.21346/) (2024)
- [Computation Resource Allocation Solution in Recommender Systems](https://mlsanity.com/paper/2103.02259/) (2021)
- [A case study of spatiotemporal forecasting techniques for weather forecasting](https://mlsanity.com/paper/2209.14782/) (2022)
- [On the Performance of Imputation Techniques for Missing Values on Healthcare Datasets](https://mlsanity.com/paper/2403.14687/) (2024)
- [MCDFN: Supply Chain Demand Forecasting via an Explainable Multi-Channel Data Fusion Network Model](https://mlsanity.com/paper/2405.15598/) (2024)
- [The Monetisation of Toxicity: Analysing YouTube Content Creators and Controversy-Driven Engagement](https://mlsanity.com/paper/2408.00534/) (2024)
- [Modelling the COVID-19 virus evolution with Incremental Machine Learning](https://mlsanity.com/paper/2104.09325/) (2021)
- [A Call for Critically Rethinking and Reforming Data Analysis in Empirical Software Engineering](https://mlsanity.com/paper/2501.12728/) (2025)
- [Hierarchical Evaluation Function: A Multi-Metric Approach for Optimizing Demand Forecasting Models](https://mlsanity.com/paper/2508.13057/) (2025)
- [Towards Error Measures which Influence a Learners Inductive Bias to the Ground Truth](https://mlsanity.com/paper/2105.01567/) (2021)
- [Predicting mental health using social media: A roadmap for future development](https://mlsanity.com/paper/2301.10453/) (2023)
- [Predicting Visit Cost of Obstructive Sleep Apnea using Electronic Healthcare Records with Transformer](https://mlsanity.com/paper/2301.12289/) (2023)
- [Reimagining Application User Interface (UI) Design using Deep Learning Methods: Challenges and Opportunities](https://mlsanity.com/paper/2303.13055/) (2023)
- [Adaptive Machine Learning for Resource-Constrained Environments](https://mlsanity.com/paper/2503.18634/) (2025)
- [PA-RNet: Perturbation-Aware Residual Network for Robust Multimodal Time Series Forecasting](https://mlsanity.com/paper/2508.04750/) (2025)
- [Reshaping Action Error Distributions for Reliable Vision-Language-Action Models](https://mlsanity.com/paper/2602.04228/) (2026)
- [Data-driven Small-signal Modeling for Converter-based Power Systems](https://mlsanity.com/paper/2108.13046/) (2021)
- [Deciphering Environmental Air Pollution with Large Scale City Data](https://mlsanity.com/paper/2109.04572/) (2021)
- [Artificial intelligence system based on multi-value classification of fully connected neural network for construction management](https://mlsanity.com/paper/2206.10604/) (2022)
- [Advancing Fluid-Based Thermal Management Systems Design: Leveraging Graph Neural Networks for Graph Regression and Efficient Enumeration Reduction](https://mlsanity.com/paper/2311.14874/) (2023)
- [Preserving Node Distinctness in Graph Autoencoders via Similarity Distillation](https://mlsanity.com/paper/2406.17517/) (2024)
- [MEMS Gyroscope Multi-Feature Calibration Using Machine Learning Technique](https://mlsanity.com/paper/2410.07519/) (2024)
- [Backdoor attacks on DNN and GBDT -- A Case Study from the insurance domain](https://mlsanity.com/paper/2412.08366/) (2024)

## Abstract (arXiv)

Performance metrics (error measures) are vital components of the evaluation frameworks in various fields. The intention of this study was to overview of a variety of performance metrics and approaches to their classification. The main goal of the study was to develop a typology that will help to improve our knowledge and understanding of metrics and facilitate their selection in machine learning regression, forecasting and prognostics. Based on the analysis of the structure of numerous performance metrics, we propose a framework of metrics which includes four (4) categories: primary metrics, extended metrics, composite metrics, and hybrid sets of metrics. The paper identified three (3) key components (dimensions) that determine the structure and properties of primary metrics: method of determining point distance, method of normalization, method of aggregation of point distances over a data set.