# Distance and Similarity Measures Effect on the Performance of K-Nearest Neighbor Classifier -- A Review

arXiv: https://arxiv.org/abs/1708.04321 · HTML: https://mlsanity.com/paper/1708.04321/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 14 Aug 2017.

## Built on by (most cited first, 26 of 26)

- [LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics](https://mlsanity.com/paper/2511.08544/) (2025)
- [Stop Oversampling for Class Imbalance Learning: A Critical Review](https://mlsanity.com/paper/2202.03579/) (2022)
- [SPINEX: Similarity-based Predictions and Explainable Neighbors Exploration for Regression and Classification Tasks in Machine Learning](https://mlsanity.com/paper/2306.01029/) (2023)
- [Current Topological and Machine Learning Applications for Bias Detection in Text](https://mlsanity.com/paper/2311.13495/) (2023)
- [A Survey on Time-Series Distance Measures](https://mlsanity.com/paper/2412.20574/) (2024)
- [Light Curve Classification with DistClassiPy: a new distance-based classifier](https://mlsanity.com/paper/2403.12120/) (2024)
- [Adaptive k-nearest neighbor classifier based on the local estimation of the shape operator](https://mlsanity.com/paper/2409.05084/) (2024)
- [KNN and K-means in Gini Prametric Spaces](https://mlsanity.com/paper/2501.18028/) (2025)
- [Applications of Binary Similarity and Distance Measures](https://mlsanity.com/paper/2307.00411/) (2023)
- [A comparative study on machine learning approaches for rock mass classification using drilling data](https://mlsanity.com/paper/2403.10404/) (2024)
- [Reliability Assessment of Information Sources Based on Random Permutation Set](https://mlsanity.com/paper/2410.22772/) (2024)
- [Evaluating Evidential Reliability In Pattern Recognition Based On Intuitionistic Fuzzy Sets](https://mlsanity.com/paper/2411.00848/) (2024)
- [Predicting Anemia Among Under-Five Children in Nepal Using Machine Learning and Deep Learning](https://mlsanity.com/paper/2602.01005/) (2026)
- [Speeding Up OPFython with Numba](https://mlsanity.com/paper/2106.11828/) (2021)
- [Experimental Investigation and Evaluation of Model-based Hyperparameter Optimization](https://mlsanity.com/paper/2107.08761/) (2021)
- [kNet: A Deep kNN Network To Handle Label Noise](https://mlsanity.com/paper/2107.09735/) (2021)
- [Anisotropic View Distance Metric for High-Dimensional Data: Theory, Geometry, and Fast Computation](https://mlsanity.com/paper/2206.05215/) (2022)
- [Deep Learning Methods for Protein Family Classification on PDB Sequencing Data](https://mlsanity.com/paper/2207.06678/) (2022)
- [Patients' Severity States Classification based on Electronic Health Record (EHR) Data using Multiple Machine Learning and Deep Learning Approaches](https://mlsanity.com/paper/2209.14907/) (2022)
- [Evaluating k-NN in the Classification of Data Streams with Concept Drift](https://mlsanity.com/paper/2210.03119/) (2022)
- [Classification of retail products: From probabilistic ranking to neural networks](https://mlsanity.com/paper/2312.07482/) (2023)
- [Enhanced Genetic Programming Models with Multiple Equations for Accurate Semi-Autogenous Grinding Mill Throughput Prediction](https://mlsanity.com/paper/2401.05382/) (2023)
- [Towards the Best Solution for Complex System Reliability: Can Statistics Outperform Machine Learning?](https://mlsanity.com/paper/2410.04238/) (2024)
- [K-GBS3FCM -- KNN Graph-Based Safe Semi-Supervised Fuzzy C-Means](https://mlsanity.com/paper/2411.14728/) (2024)
- [Comparative Performance of Finetuned ImageNet Pre-trained Models for Electronic Component Classification](https://mlsanity.com/paper/2506.19330/) (2025)
- [EasyClassifier: Honest, Reproducible Machine-Learning Classification for Researchers Who Do Not Program](https://mlsanity.com/paper/2610.04758/) (2026)

## Abstract (arXiv)

The K-nearest neighbor (KNN) classifier is one of the simplest and most common classifiers, yet its performance competes with the most complex classifiers in the literature. The core of this classifier depends mainly on measuring the distance or similarity between the tested examples and the training examples. This raises a major question about which distance measures to be used for the KNN classifier among a large number of distance and similarity measures available? This review attempts to answer this question through evaluating the performance (measured by accuracy, precision and recall) of the KNN using a large number of distance measures, tested on a number of real-world datasets, with and without adding different levels of noise. The experimental results show that the performance of KNN classifier depends significantly on the distance used, and the results showed large gaps between the performances of different distances. We found that a recently proposed non-convex distance performed the best when applied on most datasets comparing to the other tested distances. In addition, the performance of the KNN with this top performing distance degraded only about 20% while the noise level reaches 90%, this is true for most of the distances used as well. This means that the KNN classifier using any of the top 10 distances tolerate noise to a certain degree. Moreover, the results show that some distances are less affected by the added noise comparing to other distances.