Fractional norms and quasinorms do not help to overcome the curse of dimensionality
Not on the map. Why?
Abstract (arXiv)
The curse of dimensionality causes the well-known and widely discussed problems for machine learning methods. There is a hypothesis that using of the Manhattan distance and even fractional quasinorms lp (for p less than 1) can help to overcome the curse of dimensionality in classification problems. In this study, we systematically test this hypothesis. We confirm that fractional quasinorms have a greater relative contrast or coefficient of variation than the Euclidean norm l2, but we also demonstrate that the distance concentration shows qualitatively the same behaviour for all tested norms and quasinorms and the difference between them decays as dimension tends to infinity. Estimation of classification quality for kNN based on different norms and quasinorms shows that a greater relative contrast does not mean better classifier performance and the worst performance for different databases was shown by different norms (quasinorms). A systematic comparison shows that the difference of the performance of kNN based on lp for p=2, 1, and 0.5 is statistically insignificant.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 5; 2023: 2; 2024: 1; 2025: 2; 2026: 1.
13 papers.
Sort:
- 2021Scikit-dimension: a Python package for intrinsic dimension estimationcited by 68
- 2023Multi-metrics adaptively identifies backdoors in Federated learningcited by 23
- 2022Far Away in the Deep Space: Dense Nearest-Neighbor-Based Out-of-Distribution Detectioncited by 15
- 2021High-dimensional separability for one- and few-shot learningcited by 11
- 2022Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacitiescited by 9
- 2024Robust estimation of the intrinsic dimension of data sets with quantum cognition machine learningcited by 6
- 2023Ordinal Classification with Distance Regularization for Robust Brain Age Predictioncited by 4
- 2022How I learned to stop worrying and love the curse of dimensionality: an appraisal of cluster validation in high-dimensional spacescited by 1
- 2025Complexity Scaling Laws for Neural Models using Combinatorial Optimizationcited by 1
- 2022An Informational Space Based Semantic Analysis for Scientific Textscited by 0
- 2022Domain Adaptation Principal Component Analysis: base linear method for learning with out-of-distribution datacited by 0
- 2025When fractional quasi p-norms concentratecited by 0
- 2026LLMTabBench: Evaluating LLMs on Binary Tabular Classification From Zero to Few Shots23 May 2026
- 2025Complexity Scaling Laws for Neural Models using Combinatorial Optimization15 Jun 2025
- 2025When fractional quasi p-norms concentrate26 May 2025
- 2024Robust estimation of the intrinsic dimension of data sets with quantum cognition machine learning19 Sep 2024
- 2023Ordinal Classification with Distance Regularization for Robust Brain Age Prediction25 Oct 2023
- 2023Multi-metrics adaptively identifies backdoors in Federated learning12 Mar 2023
- 2022Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities20 Dec 2022
- 2022Far Away in the Deep Space: Dense Nearest-Neighbor-Based Out-of-Distribution Detection12 Nov 2022
- 2022Domain Adaptation Principal Component Analysis: base linear method for learning with out-of-distribution data28 Aug 2022
- 2022An Informational Space Based Semantic Analysis for Scientific Texts31 May 2022
- 2022How I learned to stop worrying and love the curse of dimensionality: an appraisal of cluster validation in high-dimensional spaces13 Jan 2022
- 2021Scikit-dimension: a Python package for intrinsic dimension estimation6 Sep 2021
1 more
- 2021High-dimensional separability for one- and few-shot learning28 Jun 2021
- 2021Scikit-dimension: a Python package for intrinsic dimension estimationcited by 68
- 2023Multi-metrics adaptively identifies backdoors in Federated learningcited by 23
- 2022Far Away in the Deep Space: Dense Nearest-Neighbor-Based Out-of-Distribution Detectioncited by 15
- 2021High-dimensional separability for one- and few-shot learningcited by 11
- 2022Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacitiescited by 9
- 2024Robust estimation of the intrinsic dimension of data sets with quantum cognition machine learningcited by 6
- 2023Ordinal Classification with Distance Regularization for Robust Brain Age Predictioncited by 4
- 2022How I learned to stop worrying and love the curse of dimensionality: an appraisal of cluster validation in high-dimensional spacescited by 1
- 2025Complexity Scaling Laws for Neural Models using Combinatorial Optimizationcited by 1
- 2022An Informational Space Based Semantic Analysis for Scientific Textscited by 0
- 2022Domain Adaptation Principal Component Analysis: base linear method for learning with out-of-distribution datacited by 0
- 2025When fractional quasi p-norms concentratecited by 0
12 most cited of 13 All 13 (JSON)
- 2026LLMTabBench: Evaluating LLMs on Binary Tabular Classification From Zero to Few Shots23 May 2026
- 2025Complexity Scaling Laws for Neural Models using Combinatorial Optimization15 Jun 2025
- 2025When fractional quasi p-norms concentrate26 May 2025
- 2024Robust estimation of the intrinsic dimension of data sets with quantum cognition machine learning19 Sep 2024
- 2023Ordinal Classification with Distance Regularization for Robust Brain Age Prediction25 Oct 2023
- 2023Multi-metrics adaptively identifies backdoors in Federated learning12 Mar 2023
- 2022Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities20 Dec 2022
- 2022Far Away in the Deep Space: Dense Nearest-Neighbor-Based Out-of-Distribution Detection12 Nov 2022
- 2022Domain Adaptation Principal Component Analysis: base linear method for learning with out-of-distribution data28 Aug 2022
- 2022An Informational Space Based Semantic Analysis for Scientific Texts31 May 2022
- 2022How I learned to stop worrying and love the curse of dimensionality: an appraisal of cluster validation in high-dimensional spaces13 Jan 2022
- 2021Scikit-dimension: a Python package for intrinsic dimension estimation6 Sep 2021
12 newest of 13 All 13 (JSON)