Metrics for Multi-Class Classification: an Overview
Not on the map. Why?
Abstract (arXiv)
Classification tasks in machine learning involving more than two classes are known by the name of "multi-class classification". Performance indicators are very useful when the aim is to evaluate and compare different classification models or machine learning techniques. Many metrics come in handy to test the ability of a multi-class classifier. Those metrics turn out to be useful at different stage of the development process, e.g. comparing the performance of two different models or analysing the behaviour of the same model by tuning different parameters. In this white paper we review a list of the most promising multi-class metrics, we highlight their advantages and disadvantages and show their possible usages during the development of a classification model.
Key facts. Cited by 140 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 16; 2023: 31; 2024: 35; 2025: 36; 2026: 14.
140 papers.
Sort:
By area:
- 2022Metrics reloaded: Recommendations for image analysis validationcited by 190
- 2025Proteina: Scaling Flow-based Protein Structure Generative Modelscited by 63
- 2021Common Limitations of Image Processing Metrics: A Picture Storycited by 58
- 2023Understanding metric-related pitfalls in image analysis validationcited by 57
- 2025A Comprehensive Survey of Agents for Computer Use: Foundations, Challenges, and Future Directionscited by 33
- 2023DRG-LLaMA : Tuning LLaMA Model to Predict Diagnosis-related Group for Hospitalized Patientscited by 29
- 2024A Closer Look at Classification Evaluation Metrics and a Critical Reflection of Common Evaluation Practicecited by 26
- 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluationcited by 24
- 2021Striking the Right Balance: Recall Loss for Semantic Segmentationcited by 19
- 2023Class Binarization to NeuroEvolution for Multiclass Classificationcited by 14
- 2022Deep Multimodal Guidance for Medical Image Classificationcited by 11
- 2022Automatic Mapping of Unstructured Cyber Threat Intelligence: An Experimental Studycited by 11
38 more
- 2024A Topology-aware Graph Coarsening Framework for Continual Graph Learningcited by 11
- 2024Evaluation of an LLM in Identifying Logical Fallacies: A Call for Rigor When Adopting LLMs in HCI Researchcited by 10
- 2022Application of federated learning techniques for arrhythmia classification using 12-lead ECG signalscited by 9
- 2023Learning Optimal Fair Scoring Systems for Multi-Class Classificationcited by 8
- 2023Systematic comparison of semi-supervised and self-supervised learning for medical image classificationcited by 8
- 2024Can Machine Learning Assist in Diagnosis of Primary Immune Thrombocytopenia? A feasibility studycited by 8
- 2022FOLD-RM: A Scalable, Efficient, and Explainable Inductive Learning Algorithm for Multi-Category Classification of Mixed Datacited by 7
- 2022Automated Identification of Eviction Status from Electronic Health Record Notescited by 6
- 2023Automated multilingual detection of Pro-Kremlin propaganda in newspapers and Telegram postscited by 6
- 2023Towards Heterogeneous Long-tailed Learning: Benchmarking, Metrics, and Toolboxcited by 6
- 2021The Unreasonable Effectiveness of the Baseline: Discussing SVMs in Legal Text Classificationcited by 5
- 2022Benchmark Dataset for Precipitation Forecasting by Post-Processing the Numerical Weather Predictioncited by 5
- 2024Probably Approximately Precision and Recall Learningcited by 5
- 2023Pearson-Matthews correlation coefficients for binary and multinary classification and hypothesis testingcited by 4
- 2025SampleLLM: Optimizing Tabular Data Synthesis in Recommendationscited by 4
- 2025The role of data partitioning on the performance of EEG-based deep learning models in supervised cross-subject analysis: a preliminary studycited by 4
- 2021Under-bagging Nearest Neighbors for Imbalanced Classificationcited by 3
- 2022A Vision Transformer-Based Approach to Bearing Fault Classification via Vibration Signalscited by 3
- 2023KoMultiText: Large-Scale Korean Text Dataset for Classifying Biased Speech in Real-World Online Servicescited by 3
- 2023Overview of AdaBoost : Reconciling its views to better understand its dynamicscited by 3
- 2023LoCoMotif: Discovering time-warped motifs in time seriescited by 3
- 2024A Large Language Model Outperforms Other Computational Approaches to the High-Throughput Phenotyping of Physician Notescited by 3
- 2025Deep Learning-Based Hypoglycemia Classification Across Multiple Prediction Horizonscited by 3
- 2025An Explorative Analysis of SVM Classifier and ResNet50 Architecture on African Food Classificationcited by 3
- 2023Detecting Severity of Diabetic Retinopathy from Fundus Images: A Transformer Network-based Reviewcited by 2
- 2023A Machine Learning Approach for Hierarchical Classification of Software Requirementscited by 2
- 2023A Closer Look at Bearing Fault Classification Approachescited by 2
- 2024Shaping History: Advanced Machine Learning Techniques for the Analysis and Dating of Cuneiform Tablets over Three Millenniacited by 2
- 2024Selecting a classification performance measure: matching the measure to the problemcited by 2
- 2024Enhancing Supply Chain Visibility with Generative AI: An Exploratory Case Study on Relationship Prediction in Knowledge Graphscited by 2
- 2025Adapting OpenAI's CLIP Model for Few-Shot Image Inspection in Manufacturing Quality Control: An Expository Case Study with Multiple Application Examplescited by 2
- 2025Flexible Counterfactual Explanations with Generative Modelscited by 2
- 2025LLM-Assisted Automated Deductive Coding of Dialogue Data: Leveraging Dialogue-Specific Characteristics to Enhance Contextual Understandingcited by 2
- 2025Evaluation in EEG Emotion Recognition: State-of-the-Art Review and Unified Frameworkcited by 2
- 2025Exploring LLM Capabilities in Extracting DCAT-Compatible Metadata for Data Catalogingcited by 2
- 2025Extracting latent representations from X-ray spectra. Classification, regression, and accretion signatures of Chandra sourcescited by 2
- 2022ViralBERT: A User Focused BERT-Based Approach to Virality Predictioncited by 1
- 2022Sentiment recognition of Italian elderly through domain adaptation on cross-corpus speech datasetcited by 1
50 most cited of 140 All 140 (JSON)
- 2026Infectious Bovine Pinkeye Detection Using Computer Vision and Imbalance-Aware Learning20 Sep 2026
- 2026QwenVLConnector: A Fast, Unified Medical VLM Chatbot for Fine-Grained Clinical Perception and Text Generation19 Sep 2026
- 2026Classification of Disease from Lungs X-ray Images using VGG16, VGG19 and ResNet50 Models29 Jul 2026
- 2026Diffusion MRI preprocessing affects ADC estimation and automatic PI-RADS v2.1 classification in bi-parametric prostate MRI13 Jul 2026
- 2026Listening to the Workforce: Measuring Construction Worker Safety Attitudes from Social Media Discourse Using LLMs3 Jun 2026
- 2026UA-Legal-Bench: A Benchmark for Evaluating Large Language Models on Ukrainian Legal Reasoning27 May 2026
- 2026HADS-Net:A Hybrid Attention-Augmented Dual-Stream Network with Physics-Informed Augmentation for Breast Ultrasound Image Classification19 May 2026
- 2026Online Set Learning from Precision and Recall Feedback10 May 2026
- 2026Evaluating TabPFN for Mild Cognitive Impairment to Alzheimer's Disease Conversion in Data Limited Settings29 Apr 2026
- 2026Evaluating Supervised Machine Learning Models: Principles, Pitfalls, and Metric Selection15 Apr 2026
- 2026Machine Learning-Based Detection of MCP Attacks12 Apr 2026
- 2026Comparative Analysis of Deep Learning Architectures for Multi-Disease Classification of Single-Label Chest X-rays11 Mar 2026
38 more
- 2026A foundation model for electrodermal activity data20 Feb 2026
- 2026A Two-Stage Architecture for NDA Analysis: LLM-based Segmentation and Transformer-based Clause Classification13 Feb 2026
- 2025Beyond Tokens in Language Models: Interpreting Activations through Text Genre Chunks20 Nov 2025
- 2025Causal Inference, Biomarker Discovery, Graph Neural Network, Feature Selection17 Nov 2025
- 2025An Interdisciplinary and Cross-Task Review on Missing Data Imputation3 Nov 2025
- 2025David vs. Goliath: A comparative study of different-sized LLMs for code generation in the domain of automotive scenario generation15 Oct 2025
- 2025Extracting latent representations from X-ray spectra. Classification, regression, and accretion signatures of Chandra sources15 Oct 2025
- 2025Improved mmFormer for Liver Fibrosis Staging via Missing-Modality Compensation19 Sep 2025
- 2025Enabling Down Syndrome Research through a Knowledge Graph-Driven Analytical Framework1 Sep 2025
- 2025A Systematic Literature Review on Multi-label Data Stream Classification24 Aug 2025
- 2025Weakly Supervised Fine-grained Span-Level Framework for Chinese Radiology Report Quality Assurance12 Aug 2025
- 2025Multidimensional classification of posts for online course discussion forum curation5 Aug 2025
- 2025Automatically assessing oral narratives of Afrikaans and isiXhosa children17 Jul 2025
- 2025A Semi-Supervised Learning Method for the Identification of Bad Exposures in Large Imaging Surveys17 Jul 2025
- 2025TransformEEG: Towards Improving Model Generalizability in Deep Learning-based EEG Parkinson's Disease Detection10 Jul 2025
- 2025Exploring LLM Capabilities in Extracting DCAT-Compatible Metadata for Data Cataloging4 Jul 2025
- 2025Ensemble BERT for Medication Event Classification on Electronic Health Records (EHRs)29 Jun 2025
- 2025Comparing Credit Risk Estimates in the Gen-AI Era9 Jun 2025
- 2025An Explorative Analysis of SVM Classifier and ResNet50 Architecture on African Food Classification20 May 2025
- 2025The role of data partitioning on the performance of EEG-based deep learning models in supervised cross-subject analysis: a preliminary study19 May 2025
- 2025Evaluation in EEG Emotion Recognition: State-of-the-Art Review and Unified Framework14 May 2025
- 2025KnowEEG: Explainable Knowledge Driven EEG Classification1 May 2025
- 2025LLM-Assisted Automated Deductive Coding of Dialogue Data: Leveraging Dialogue-Specific Characteristics to Enhance Contextual Understanding28 Apr 2025
- 2025Crisp complexity of fuzzy classifiers22 Apr 2025
- 2025ThyroidEffi 1.0: A Cost-Effective System for High-Performance Multi-Class Thyroid Carcinoma Classification19 Apr 2025
- 2025RAID: An In-Training Defense against Attribute Inference Attacks in Recommender Systems15 Apr 2025
- 2025Deep Learning-Based Hypoglycemia Classification Across Multiple Prediction Horizons25 Mar 2025
- 2025Using machine learning to map simulated noisy and laser-limited multidimensional spectra to molecular electronic couplings19 Mar 2025
- 2025Iffy-Or-Not: Extending the Web to Support the Critical Evaluation of Fallacious Texts18 Mar 2025
- 2025Cross-Subject Depression Level Classification Using EEG Signals with a Sample Confidence Method4 Mar 2025
- 2025Proteina: Scaling Flow-based Protein Structure Generative Models2 Mar 2025
- 2025Flexible Counterfactual Explanations with Generative Models24 Feb 2025
- 2025Interpreting core forms of urban morphology linked to urban functions with explainable graph neural network22 Feb 2025
- 2025Vision-Language In-Context Learning Driven Few-Shot Visual Inspection Model13 Feb 2025
- 2025A Comprehensive Survey of Agents for Computer Use: Foundations, Challenges, and Future Directions27 Jan 2025
- 2025SampleLLM: Optimizing Tabular Data Synthesis in Recommendations27 Jan 2025
- 2025Adapting OpenAI's CLIP Model for Few-Shot Image Inspection in Manufacturing Quality Control: An Expository Case Study with Multiple Application Examples22 Jan 2025
- 2025Uncertainty Guarantees on Automated Precision Weeding using Conformal Prediction13 Jan 2025
50 newest of 140 All 140 (JSON)
- 2022Metrics reloaded: Recommendations for image analysis validationcited by 190
- 2025Proteina: Scaling Flow-based Protein Structure Generative Modelscited by 63
- 2021Common Limitations of Image Processing Metrics: A Picture Storycited by 58
- 2023Understanding metric-related pitfalls in image analysis validationcited by 57
- 2023DRG-LLaMA : Tuning LLaMA Model to Predict Diagnosis-related Group for Hospitalized Patientscited by 29
- 2024A Closer Look at Classification Evaluation Metrics and a Critical Reflection of Common Evaluation Practicecited by 26
- 2023A review of ensemble learning and data augmentation models for class imbalanced problems: combination, implementation and evaluationcited by 24
- 2021Striking the Right Balance: Recall Loss for Semantic Segmentationcited by 19
- 2023Class Binarization to NeuroEvolution for Multiclass Classificationcited by 14
- 2022Deep Multimodal Guidance for Medical Image Classificationcited by 11
- 2022Automatic Mapping of Unstructured Cyber Threat Intelligence: An Experimental Studycited by 11
- 2024A Topology-aware Graph Coarsening Framework for Continual Graph Learningcited by 11
12 most cited of 135 All 135 (JSON)
- 2026Infectious Bovine Pinkeye Detection Using Computer Vision and Imbalance-Aware Learning20 Sep 2026
- 2026Classification of Disease from Lungs X-ray Images using VGG16, VGG19 and ResNet50 Models29 Jul 2026
- 2026Diffusion MRI preprocessing affects ADC estimation and automatic PI-RADS v2.1 classification in bi-parametric prostate MRI13 Jul 2026
- 2026Listening to the Workforce: Measuring Construction Worker Safety Attitudes from Social Media Discourse Using LLMs3 Jun 2026
- 2026HADS-Net:A Hybrid Attention-Augmented Dual-Stream Network with Physics-Informed Augmentation for Breast Ultrasound Image Classification19 May 2026
- 2026Online Set Learning from Precision and Recall Feedback10 May 2026
- 2026Evaluating TabPFN for Mild Cognitive Impairment to Alzheimer's Disease Conversion in Data Limited Settings29 Apr 2026
- 2026Evaluating Supervised Machine Learning Models: Principles, Pitfalls, and Metric Selection15 Apr 2026
- 2026Machine Learning-Based Detection of MCP Attacks12 Apr 2026
- 2026Comparative Analysis of Deep Learning Architectures for Multi-Disease Classification of Single-Label Chest X-rays11 Mar 2026
- 2026A foundation model for electrodermal activity data20 Feb 2026
- 2026A Two-Stage Architecture for NDA Analysis: LLM-based Segmentation and Transformer-based Clause Classification13 Feb 2026
12 newest of 135 All 135 (JSON)