Performance Metrics (Error Measures) in Machine Learning Regression, Forecasting and Prognostics: Properties and Typology
Not on the map. Why?
Abstract (arXiv)
Performance metrics (error measures) are vital components of the evaluation frameworks in various fields. The intention of this study was to overview of a variety of performance metrics and approaches to their classification. The main goal of the study was to develop a typology that will help to improve our knowledge and understanding of metrics and facilitate their selection in machine learning regression, forecasting and prognostics. Based on the analysis of the structure of numerous performance metrics, we propose a framework of metrics which includes four (4) categories: primary metrics, extended metrics, composite metrics, and hybrid sets of metrics. The paper identified three (3) key components (dimensions) that determine the structure and properties of primary metrics: method of determining point distance, method of normalization, method of aggregation of point distances over a data set.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 4; 2023: 4; 2024: 9; 2025: 9; 2026: 2.
35 papers.
Sort:
By area:
- 2022Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learningcited by 47
- 2021Predicting the Mechanical Properties of Biopolymer Gels Using Neural Networks Trained on Discrete Fiber Network Datacited by 6
- 2022Intra-domain and cross-domain transfer learning for time series data -- How transferable are the features?cited by 6
- 2025Lost in Serialization: Invariance and Generalization of LLM Graph Reasonerscited by 6
- 2024How many samples are needed to train a deep neural network?cited by 5
- 2021A Look at the Evaluation Setup of the M5 Forecasting Competitioncited by 4
- 2024A Comparative Study of Sampling Methods with Cross-Validation in the FedHome Frameworkcited by 4
- 2021Computation Resource Allocation Solution in Recommender Systemscited by 3
- 2022A case study of spatiotemporal forecasting techniques for weather forecastingcited by 3
- 2024On the Performance of Imputation Techniques for Missing Values on Healthcare Datasetscited by 3
- 2024MCDFN: Supply Chain Demand Forecasting via an Explainable Multi-Channel Data Fusion Network Modelcited by 3
- 2024The Monetisation of Toxicity: Analysing YouTube Content Creators and Controversy-Driven Engagementcited by 3
23 more
- 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approachcited by 3
- 2021Modelling the COVID-19 virus evolution with Incremental Machine Learningcited by 2
- 2025A Call for Critically Rethinking and Reforming Data Analysis in Empirical Software Engineeringcited by 2
- 2025Hierarchical Evaluation Function: A Multi-Metric Approach for Optimizing Demand Forecasting Modelscited by 2
- 2021Towards Error Measures which Influence a Learners Inductive Bias to the Ground Truthcited by 1
- 2023Predicting mental health using social media: A roadmap for future developmentcited by 1
- 2023Predicting Visit Cost of Obstructive Sleep Apnea using Electronic Healthcare Records with Transformercited by 1
- 2023Reimagining Application User Interface (UI) Design using Deep Learning Methods: Challenges and Opportunitiescited by 1
- 2025Adaptive Machine Learning for Resource-Constrained Environmentscited by 1
- 2026Reshaping Action Error Distributions for Reliable Vision-Language-Action Modelscited by 1
- 2021Data-driven Small-signal Modeling for Converter-based Power Systemscited by 0
- 2021Deciphering Environmental Air Pollution with Large Scale City Datacited by 0
- 2022Artificial intelligence system based on multi-value classification of fully connected neural network for construction managementcited by 0
- 2023Advancing Fluid-Based Thermal Management Systems Design: Leveraging Graph Neural Networks for Graph Regression and Efficient Enumeration Reductioncited by 0
- 2024Preserving Node Distinctness in Graph Autoencoders via Similarity Distillationcited by 0
- 2024MEMS Gyroscope Multi-Feature Calibration Using Machine Learning Techniquecited by 0
- 2024Backdoor attacks on DNN and GBDT -- A Case Study from the insurance domaincited by 0
- 2025What should an AI assessor optimise for?cited by 0
- 2025Model-Free Adversarial Purification via Coarse-To-Fine Tensor Network Representationcited by 0
- 2025Controlling Context: Generative AI at Work in Integrated Circuit Design and Other High-Precision Domainscited by 0
- 2025PA-RNet: Perturbation-Aware Residual Network for Robust Multimodal Time Series Forecastingcited by 0
- 2025Extreme value forecasting using relevance-based data augmentation with deep learning modelscited by 0
- 2026Transforming Heart Disease Prediction with Advanced Machine Learning Techniquescited by 0
- 2026Transforming Heart Disease Prediction with Advanced Machine Learning Techniques19 Aug 2026
- 2026Reshaping Action Error Distributions for Reliable Vision-Language-Action Models4 Feb 2026
- 2025Lost in Serialization: Invariance and Generalization of LLM Graph Reasoners13 Nov 2025
- 2025Extreme value forecasting using relevance-based data augmentation with deep learning models2 Oct 2025
- 2025Hierarchical Evaluation Function: A Multi-Metric Approach for Optimizing Demand Forecasting Models18 Aug 2025
- 2025PA-RNet: Perturbation-Aware Residual Network for Robust Multimodal Time Series Forecasting6 Aug 2025
- 2025Controlling Context: Generative AI at Work in Integrated Circuit Design and Other High-Precision Domains17 Jun 2025
- 2025Adaptive Machine Learning for Resource-Constrained Environments24 Mar 2025
- 2025Model-Free Adversarial Purification via Coarse-To-Fine Tensor Network Representation25 Feb 2025
- 2025What should an AI assessor optimise for?1 Feb 2025
- 2025A Call for Critically Rethinking and Reforming Data Analysis in Empirical Software Engineering22 Jan 2025
- 2024Backdoor attacks on DNN and GBDT -- A Case Study from the insurance domain11 Dec 2024
23 more
- 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach28 Oct 2024
- 2024MEMS Gyroscope Multi-Feature Calibration Using Machine Learning Technique10 Oct 2024
- 2024The Monetisation of Toxicity: Analysing YouTube Content Creators and Controversy-Driven Engagement1 Aug 2024
- 2024Preserving Node Distinctness in Graph Autoencoders via Similarity Distillation25 Jun 2024
- 2024A Comparative Study of Sampling Methods with Cross-Validation in the FedHome Framework4 Jun 2024
- 2024How many samples are needed to train a deep neural network?26 May 2024
- 2024MCDFN: Supply Chain Demand Forecasting via an Explainable Multi-Channel Data Fusion Network Model24 May 2024
- 2024On the Performance of Imputation Techniques for Missing Values on Healthcare Datasets13 Mar 2024
- 2023Advancing Fluid-Based Thermal Management Systems Design: Leveraging Graph Neural Networks for Graph Regression and Efficient Enumeration Reduction24 Nov 2023
- 2023Reimagining Application User Interface (UI) Design using Deep Learning Methods: Challenges and Opportunities23 Mar 2023
- 2023Predicting Visit Cost of Obstructive Sleep Apnea using Electronic Healthcare Records with Transformer28 Jan 2023
- 2023Predicting mental health using social media: A roadmap for future development25 Jan 2023
- 2022A case study of spatiotemporal forecasting techniques for weather forecasting29 Sep 2022
- 2022Artificial intelligence system based on multi-value classification of fully connected neural network for construction management19 Jun 2022
- 2022Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learning10 Feb 2022
- 2022Intra-domain and cross-domain transfer learning for time series data -- How transferable are the features?12 Jan 2022
- 2021Deciphering Environmental Air Pollution with Large Scale City Data9 Sep 2021
- 2021Data-driven Small-signal Modeling for Converter-based Power Systems30 Aug 2021
- 2021A Look at the Evaluation Setup of the M5 Forecasting Competition8 Aug 2021
- 2021Towards Error Measures which Influence a Learners Inductive Bias to the Ground Truth4 May 2021
- 2021Modelling the COVID-19 virus evolution with Incremental Machine Learning14 Apr 2021
- 2021Computation Resource Allocation Solution in Recommender Systems3 Mar 2021
- 2021Predicting the Mechanical Properties of Biopolymer Gels Using Neural Networks Trained on Discrete Fiber Network Data23 Jan 2021
- 2022Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learningcited by 47
- 2021Predicting the Mechanical Properties of Biopolymer Gels Using Neural Networks Trained on Discrete Fiber Network Datacited by 6
- 2022Intra-domain and cross-domain transfer learning for time series data -- How transferable are the features?cited by 6
- 2024How many samples are needed to train a deep neural network?cited by 5
- 2021A Look at the Evaluation Setup of the M5 Forecasting Competitioncited by 4
- 2024A Comparative Study of Sampling Methods with Cross-Validation in the FedHome Frameworkcited by 4
- 2021Computation Resource Allocation Solution in Recommender Systemscited by 3
- 2022A case study of spatiotemporal forecasting techniques for weather forecastingcited by 3
- 2024On the Performance of Imputation Techniques for Missing Values on Healthcare Datasetscited by 3
- 2024MCDFN: Supply Chain Demand Forecasting via an Explainable Multi-Channel Data Fusion Network Modelcited by 3
- 2024The Monetisation of Toxicity: Analysing YouTube Content Creators and Controversy-Driven Engagementcited by 3
- 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approachcited by 3
12 most cited of 33 All 33 (JSON)
- 2026Transforming Heart Disease Prediction with Advanced Machine Learning Techniques19 Aug 2026
- 2025Extreme value forecasting using relevance-based data augmentation with deep learning models2 Oct 2025
- 2025Hierarchical Evaluation Function: A Multi-Metric Approach for Optimizing Demand Forecasting Models18 Aug 2025
- 2025PA-RNet: Perturbation-Aware Residual Network for Robust Multimodal Time Series Forecasting6 Aug 2025
- 2025Controlling Context: Generative AI at Work in Integrated Circuit Design and Other High-Precision Domains17 Jun 2025
- 2025Adaptive Machine Learning for Resource-Constrained Environments24 Mar 2025
- 2025Model-Free Adversarial Purification via Coarse-To-Fine Tensor Network Representation25 Feb 2025
- 2025What should an AI assessor optimise for?1 Feb 2025
- 2025A Call for Critically Rethinking and Reforming Data Analysis in Empirical Software Engineering22 Jan 2025
- 2024Backdoor attacks on DNN and GBDT -- A Case Study from the insurance domain11 Dec 2024
- 2024Towards Trustworthy Machine Learning in Production: An Overview of the Robustness in MLOps Approach28 Oct 2024
- 2024MEMS Gyroscope Multi-Feature Calibration Using Machine Learning Technique10 Oct 2024
12 newest of 33 All 33 (JSON)