k-Nearest Neighbour Classifiers: 2nd Edition (with Python examples)
Not on the map. Why?
Abstract (arXiv)
Perhaps the most straightforward classifier in the arsenal or machine learning techniques is the Nearest Neighbour Classifier -- classification is achieved by identifying the nearest neighbours to a query example and using those neighbours to determine the class of the query. This approach to classification is of particular importance because issues of poor run-time performance is not such a problem these days with the computational power that is available. This paper presents an overview of techniques for Nearest Neighbour classification focusing on; mechanisms for assessing similarity (distance), computational issues in identifying nearest neighbours and mechanisms for reducing the dimension of the data. This paper is the second edition of a paper previously published as a technical report. Sections on similarity measures for time-series, retrieval speed-up and intrinsic dimensionality have been added. An Appendix is included providing access to Python code for the key methods.
Key facts. Cited by 56 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 3; 2022: 8; 2023: 12; 2024: 13; 2025: 15; 2026: 5.
56 papers.
Sort:
By area:
- 2021A unified logical framework for explanations in classifier systemscited by 15
- 2023Large Language Models as Batteries-Included Zero-Shot ESCO Skills Matcherscited by 15
- 2023Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-artcited by 14
- 2023GyroFlow+: Gyroscope-Guided Unsupervised Deep Homography and Optical Flow Learningcited by 10
- 2023Task-Driven Causal Feature Distillation: Towards Trustworthy Risk Predictioncited by 9
- 2023Global Proxy-based Hard Mining for Visual Place Recognitioncited by 8
- 2024Integrating kNN with Foundation Models for Adaptable and Privacy-Aware Image Classificationcited by 5
- 2022Combining Varied Learners for Binary Classification using Stacked Generalizationcited by 4
- 2025BudgetLeak: Membership Inference Attacks on RAG Systems via the Generation Budget Side Channelcited by 3
- 2022Detection of Tool based Edited Images from Error Level Analysis and Convolutional Neural Networkcited by 2
- 2024LOSS-GAT: Label Propagation and One-Class Semi-Supervised Graph Attention Network for Fake News Detectioncited by 2
- 2024Sources of Gain: Decomposing Performance in Conditional Average Dose Response Estimationcited by 2
38 more
- 2024CAVE-Net: Classifying Abnormalities in Video Capsule Endoscopycited by 2
- 2025CodingHomo: Bootstrapping Deep Homography With Video Codingcited by 2
- 2025DINO-MX: A Modular & Flexible Framework for Self-Supervised Learningcited by 2
- 2022Vital Node Identification in Complex Networks Using a Machine Learning-Based Approachcited by 1
- 2022A k nearest neighbours classifiers ensemble based on extended neighbourhood rule and features subsetscited by 1
- 2023A unified weighting framework for evaluating nearest neighbour classificationcited by 1
- 2023DoDo-Code: an Efficient Levenshtein Distance Embedding-based Code for 4-ary IDS Channelcited by 1
- 2023Optimizing Ego Vehicle Trajectory Prediction: The Graph Enhancement Approachcited by 1
- 2024Hyper-STTN: Hypergraph Augmented Spatial-Temporal Transformer Network for Trajectory Predictioncited by 1
- 2024Machine learning and natural language processing models to predict the extent of food processingcited by 1
- 2025Detecting and Mitigating DDoS Attacks with AI: A Surveycited by 1
- 2025From Data to Decision: A Multi-Stage Framework for Class Imbalance Mitigation in Optical Network Failure Analysiscited by 1
- 2025A Comparison of Selected Image Transformation Techniques for Malware Classificationcited by 1
- 2025A Perception CNN for Facial Expression Recognitioncited by 1
- 2026Reasoning through Verifiable Forecast Actions: Consistency-Grounded RL for Financial LLMscited by 1
- 2021An Automated Data Engineering Pipeline for Anomaly Detection of IoT Sensor Datacited by 0
- 2021Sub-Setting Algorithm for Training Data Selection in Pattern Recognitioncited by 0
- 2022Performance Comparison of Simple Transformer and Res-CNN-BiLSTM for Cyberbullying Classificationcited by 0
- 2022Investigation of a Machine learning methodology for the SKA pulsar search pipelinecited by 0
- 2022Learning New Tasks from a Few Examples with Soft-Label Prototypescited by 0
- 2022POSSE-kNN: Pathwise Out-of-Bag Selected Subspace Ensembles for Binary Classificationcited by 0
- 2023A Random Projection k Nearest Neighbours Ensemble for Classification via Extended Neighbourhood Rulecited by 0
- 2023LowDINO -- A Low Parameter Self Supervised Learning Modelcited by 0
- 2023Leaving the Lines Behind: Vision-Based Crop Row Exit for Agricultural Robot Navigationcited by 0
- 2023Enhancing Binary Code Comment Quality Classification: Integrating Generative AI for Improved Accuracycited by 0
- 2024A Smartphone-Based Method for Assessing Tomato Nutrient Status through Trichome Density Measurementcited by 0
- 2024Unsupervised explainable activity prediction in competitive Nordic Walking from experimental datacited by 0
- 2024Enhancing Microgrid Performance Prediction with Attention-based Deep Learning Modelscited by 0
- 2024Cost-informed dimensionality reduction for structural digital twin technologiescited by 0
- 2024AI Learning Algorithms: Deep Learning, Hybrid Models, and Large-Scale Model Integrationcited by 0
- 2024Classifier Enhanced Deep Learning Model for Erythroblast Differentiation with Limited Datacited by 0
- 2024Machine learning-based classification for Single Photon Space Debris Light Curvescited by 0
- 2025A Pan-cancer Classification Model using Multi-view Feature Selection Method and Ensemble Classifiercited by 0
- 2025A Novel Double Pruning method for Imbalanced Data using Information Entropy and Roulette Wheel Selection for Breast Cancer Diagnosiscited by 0
- 2025FeNeC: Enhancing Continual Learning via Feature Clustering with Neighbor- or Logit-Based Classificationcited by 0
- 2025Estimating 2D Camera Motion with Hybrid Motion Basiscited by 0
- 2025Beyond Rebalancing: Benchmarking Binary Classifiers Under Class Imbalance Without Rebalancing Techniquescited by 0
- 2025Transformer-Gather, Fuzzy-Reconsider: A Scalable Hybrid Framework for Entity Resolutioncited by 0
50 most cited of 56 All 56 (JSON)
- 2026CamFlow+: Hybrid Motion Bases for 2D Camera Motion Estimation with Stabilization Applications4 Jun 2026
- 2026Reasoning through Verifiable Forecast Actions: Consistency-Grounded RL for Financial LLMs21 May 2026
- 2026Federated Hierarchical Clustering with Automatic Selection of Optimal Cluster Numbers13 Mar 2026
- 2026Optimizing Multi-Modal Models for Image-Based Shape Retrieval: The Role of Pre-Alignment and Hard Contrastive Learning7 Mar 2026
- 2026SMc2f: Robust Scenario Mining for Robotic Autonomy from Coarse to Fine17 Jan 2026
- 2025Graph Convolutional Long Short-Term Memory Attention Network for Post-Stroke Compensatory Movement Detection Based on Skeleton Data7 Dec 2025
- 2025A Perception CNN for Facial Expression Recognition6 Dec 2025
- 2025BudgetLeak: Membership Inference Attacks on RAG Systems via the Generation Budget Side Channel15 Nov 2025
- 2025DINO-MX: A Modular & Flexible Framework for Self-Supervised Learning3 Nov 2025
- 2025Provenance Networks: End-to-End Exemplar-Based Explainability3 Oct 2025
- 2025Transformer-Gather, Fuzzy-Reconsider: A Scalable Hybrid Framework for Entity Resolution22 Sep 2025
- 2025A Comparison of Selected Image Transformation Techniques for Malware Classification13 Sep 2025
38 more
- 2025Beyond Rebalancing: Benchmarking Binary Classifiers Under Class Imbalance Without Rebalancing Techniques9 Sep 2025
- 2025From Data to Decision: A Multi-Stage Framework for Class Imbalance Mitigation in Optical Network Failure Analysis25 Aug 2025
- 2025Estimating 2D Camera Motion with Hybrid Motion Basis30 Jul 2025
- 2025CodingHomo: Bootstrapping Deep Homography With Video Coding16 Apr 2025
- 2025Detecting and Mitigating DDoS Attacks with AI: A Survey22 Mar 2025
- 2025FeNeC: Enhancing Continual Learning via Feature Clustering with Neighbor- or Logit-Based Classification18 Mar 2025
- 2025A Novel Double Pruning method for Imbalanced Data using Information Entropy and Roulette Wheel Selection for Breast Cancer Diagnosis15 Mar 2025
- 2025A Pan-cancer Classification Model using Multi-view Feature Selection Method and Ensemble Classifier12 Jan 2025
- 2024Machine learning and natural language processing models to predict the extent of food processing23 Dec 2024
- 2024Machine learning-based classification for Single Photon Space Debris Light Curves27 Nov 2024
- 2024Classifier Enhanced Deep Learning Model for Erythroblast Differentiation with Limited Data23 Nov 2024
- 2024CAVE-Net: Classifying Abnormalities in Video Capsule Endoscopy26 Oct 2024
- 2024AI Learning Algorithms: Deep Learning, Hybrid Models, and Large-Scale Model Integration11 Oct 2024
- 2024Cost-informed dimensionality reduction for structural digital twin technologies17 Sep 2024
- 2024Enhancing Microgrid Performance Prediction with Attention-based Deep Learning Models20 Jul 2024
- 2024Unsupervised explainable activity prediction in competitive Nordic Walking from experimental data18 Jun 2024
- 2024Sources of Gain: Decomposing Performance in Conditional Average Dose Response Estimation12 Jun 2024
- 2024A Smartphone-Based Method for Assessing Tomato Nutrient Status through Trichome Density Measurement30 Apr 2024
- 2024Integrating kNN with Foundation Models for Adaptable and Privacy-Aware Image Classification19 Feb 2024
- 2024LOSS-GAT: Label Propagation and One-Class Semi-Supervised Graph Attention Network for Fake News Detection13 Feb 2024
- 2024Hyper-STTN: Hypergraph Augmented Spatial-Temporal Transformer Network for Trajectory Prediction12 Jan 2024
- 2023Task-Driven Causal Feature Distillation: Towards Trustworthy Risk Prediction20 Dec 2023
- 2023Optimizing Ego Vehicle Trajectory Prediction: The Graph Enhancement Approach20 Dec 2023
- 2023DoDo-Code: an Efficient Levenshtein Distance Embedding-based Code for 4-ary IDS Channel20 Dec 2023
- 2023A unified weighting framework for evaluating nearest neighbour classification28 Nov 2023
- 2023Enhancing Binary Code Comment Quality Classification: Integrating Generative AI for Improved Accuracy14 Oct 2023
- 2023Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-art30 Aug 2023
- 2023Large Language Models as Batteries-Included Zero-Shot ESCO Skills Matchers7 Jul 2023
- 2023Leaving the Lines Behind: Vision-Based Crop Row Exit for Agricultural Robot Navigation9 Jun 2023
- 2023LowDINO -- A Low Parameter Self Supervised Learning Model28 May 2023
- 2023A Random Projection k Nearest Neighbours Ensemble for Classification via Extended Neighbourhood Rule21 Mar 2023
- 2023Global Proxy-based Hard Mining for Visual Place Recognition28 Feb 2023
- 2023GyroFlow+: Gyroscope-Guided Unsupervised Deep Homography and Optical Flow Learning23 Jan 2023
- 2022POSSE-kNN: Pathwise Out-of-Bag Selected Subspace Ensembles for Binary Classification21 Nov 2022
- 2022Learning New Tasks from a Few Examples with Soft-Label Prototypes31 Oct 2022
- 2022Investigation of a Machine learning methodology for the SKA pulsar search pipeline9 Sep 2022
- 2022Performance Comparison of Simple Transformer and Res-CNN-BiLSTM for Cyberbullying Classification5 Jun 2022
- 2022A k nearest neighbours classifiers ensemble based on extended neighbourhood rule and features subsets30 May 2022
50 newest of 56 All 56 (JSON)
- 2021A unified logical framework for explanations in classifier systemscited by 15
- 2023Large Language Models as Batteries-Included Zero-Shot ESCO Skills Matcherscited by 15
- 2023Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-artcited by 14
- 2023GyroFlow+: Gyroscope-Guided Unsupervised Deep Homography and Optical Flow Learningcited by 10
- 2023Global Proxy-based Hard Mining for Visual Place Recognitioncited by 8
- 2024Integrating kNN with Foundation Models for Adaptable and Privacy-Aware Image Classificationcited by 5
- 2022Combining Varied Learners for Binary Classification using Stacked Generalizationcited by 4
- 2022Detection of Tool based Edited Images from Error Level Analysis and Convolutional Neural Networkcited by 2
- 2024LOSS-GAT: Label Propagation and One-Class Semi-Supervised Graph Attention Network for Fake News Detectioncited by 2
- 2024Sources of Gain: Decomposing Performance in Conditional Average Dose Response Estimationcited by 2
- 2024CAVE-Net: Classifying Abnormalities in Video Capsule Endoscopycited by 2
- 2025CodingHomo: Bootstrapping Deep Homography With Video Codingcited by 2
12 most cited of 53 All 53 (JSON)
- 2026CamFlow+: Hybrid Motion Bases for 2D Camera Motion Estimation with Stabilization Applications4 Jun 2026
- 2026Federated Hierarchical Clustering with Automatic Selection of Optimal Cluster Numbers13 Mar 2026
- 2026Optimizing Multi-Modal Models for Image-Based Shape Retrieval: The Role of Pre-Alignment and Hard Contrastive Learning7 Mar 2026
- 2026SMc2f: Robust Scenario Mining for Robotic Autonomy from Coarse to Fine17 Jan 2026
- 2025Graph Convolutional Long Short-Term Memory Attention Network for Post-Stroke Compensatory Movement Detection Based on Skeleton Data7 Dec 2025
- 2025A Perception CNN for Facial Expression Recognition6 Dec 2025
- 2025DINO-MX: A Modular & Flexible Framework for Self-Supervised Learning3 Nov 2025
- 2025Provenance Networks: End-to-End Exemplar-Based Explainability3 Oct 2025
- 2025Transformer-Gather, Fuzzy-Reconsider: A Scalable Hybrid Framework for Entity Resolution22 Sep 2025
- 2025A Comparison of Selected Image Transformation Techniques for Malware Classification13 Sep 2025
- 2025Beyond Rebalancing: Benchmarking Binary Classifiers Under Class Imbalance Without Rebalancing Techniques9 Sep 2025
- 2025From Data to Decision: A Multi-Stage Framework for Class Imbalance Mitigation in Optical Network Failure Analysis25 Aug 2025
12 newest of 53 All 53 (JSON)