RankSim: Ranking Similarity Regularization for Deep Imbalanced Regression
Not on the map. Why?
Abstract (arXiv)
Data imbalance, in which a plurality of the data samples come from a small proportion of labels, poses a challenge in training deep neural networks. Unlike classification, in regression the labels are continuous, potentially boundless, and form a natural ordering. These distinct features of regression call for new techniques that leverage the additional information encoded in label-space relationships. This paper presents the RankSim (ranking similarity) regularizer for deep imbalanced regression, which encodes an inductive bias that samples that are closer in label space should also be closer in feature space. In contrast to recent distribution smoothing based approaches, RankSim captures both nearby and distant relationships: for a given data sample, RankSim encourages the sorted list of its neighbors in label space to match the sorted list of its neighbors in feature space. RankSim is complementary to conventional imbalanced learning techniques, including re-weighting, two-stage training, and distribution smoothing, and lifts the state-of-the-art performance on three imbalanced regression benchmarks: IMDB-WIKI-DIR, AgeDB-DIR, and STS-B-DIR.
Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). Builds on 28 of its 40 references that are in the map. First posted on arXiv 30 May 2022.
Builds on
28 of 40 references.
References · 28
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
- 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 1,001
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 809
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 705
- 2017A systematic study of the class imbalance problem in convolutional neural networkscited by 513
- 2020Balanced Meta-Softmax for Long-Tailed Visual Recognitioncited by 400
- 2020Long-Tailed Classification by Keeping the Good and Removing the Bad Momentum Causal Effectcited by 256
- 2018What is the Effect of Importance Weighting in Deep Learning?cited by 251
- 2019Differentiation of Blackbox Combinatorial Solverscited by 226
- 2020Rethinking the Value of Labels for Improving Class-Imbalanced Learningcited by 216
16 more
- 2021Improving Calibration for Long-Tailed Recognitioncited by 212
- 2019Learning with Average Precision: Training Image Retrieval with a Listwise Losscited by 185
- 2021Delving into Deep Imbalanced Regressioncited by 158
- 2020Remix: Rebalanced Mixupcited by 144
- 2019Differentiable Ranks and Sorting using Optimal Transportcited by 113
- 2019Implicit Semantic Data Augmentation for Deep Networkscited by 106
- 2019Optimizing Rank-based Metrics with Blackbox Differentiationcited by 58
- 2020Posterior Re-calibration for Imbalanced Datasetscited by 53
- 2016Learning Deep Embeddings with Histogram Losscited by 52
- 2021Self-Damaging Contrastive Learningcited by 48
- 2021Towards Calibrated Model for Long-Tailed Visual Recognition from Prior Perspectivecited by 39
- 2021PML: Progressive Margin Loss for Long-tailed Age Classificationcited by 32
- 2019SoDeep: a Sorting Deep net to learn ranking loss surrogatescited by 28
- 2021Image-Level or Object-Level? A Tale of Two Resampling Strategies for Long-Tailed Detectioncited by 27
- 2015Training Deep Neural Networks via Direct Loss Minimizationcited by 25
- 2017Hashing as Tie-Aware Learning to Rankcited by 18
Built on by
Citing papers per year: 2022: 1; 2023: 15; 2024: 12; 2025: 15; 2026: 9.
52 papers.
Sort:
By area:
- 2022Rank-N-Contrast: Learning Continuous Representations for Regressioncited by 76
- 2023Improving Deep Regression with Ordinal Entropycited by 45
- 2023Learning-to-Rank Meets Language: Boosting Language-Driven Ordering Alignment for Ordinal Classificationcited by 21
- 2023ConR: Contrastive Regularizer for Deep Imbalanced Regressioncited by 19
- 2023A step towards understanding why classification helps regressioncited by 15
- 2023Semi-Supervised Graph Imbalanced Regressioncited by 14
- 2024AFreeCA: Annotation-Free Counting for Allcited by 12
- 2025CLOC: Contrastive Learning for Ordinal Classification with Multi-Margin N-pair Losscited by 11
- 2025A Comprehensive Survey on Imbalanced Data Learningcited by 10
- 2023Deep Imbalanced Regression via Hierarchical Classification Adjustmentcited by 9
- 2024IM-Context: In-Context Learning for Imbalanced Regression Taskscited by 7
- 2024Interpretable Cascading Mixture-of-Experts for Urban Traffic Congestion Predictioncited by 7
38 more
- 2024Rank and Align: Towards Effective Source-free Graph Domain Adaptationcited by 7
- 2025Improve Representation for Imbalanced Regression through Geometric Constraintscited by 7
- 2024Are we making much progress? Revisiting chemical reaction yield prediction from an imbalanced regression perspectivecited by 6
- 2024Data Augmentation with Variational Autoencoder for Imbalanced Datasetcited by 5
- 2023Uncertainty Voting Ensemble for Imbalanced Deep Regressioncited by 4
- 2023Continual Learning in Predictive Autoscalingcited by 4
- 2023Generalized Oversampling for Learning from Imbalanced datasets and Associated Theorycited by 4
- 2025Sample Selection via Contrastive Fragmentation for Noisy Label Regressioncited by 4
- 2024Dist Loss: Enhancing Regression in Few-Shot Region through Distribution Distance Constraintcited by 3
- 2023AdaFlood: Adaptive Flood Regularizationcited by 2
- 2024Gradient Aligned Regression via Pairwise Lossescited by 2
- 2024Boarding for ISS: Imbalanced Self-Supervised: Discovery of a Scaled Autoencoder for Mixed Tabular Datasetscited by 2
- 2025PoGDiff: Product-of-Gaussians Diffusion Models for Imbalanced Text-to-Image Generationcited by 2
- 2025Improving Deep Regression with Tightnesscited by 2
- 2023Ranking Regularization for Critical Rare Classes: Minimizing False Positives at a High True Positive Ratecited by 1
- 2023Variational Imbalanced Regression: Fair Uncertainty Quantification via Probabilistic Smoothingcited by 1
- 2024Optimizing Automatic Speech Assessment: W-RankSim Regularization and Hybrid Feature Fusion Strategiescited by 1
- 2024Deep Imbalanced Regression to Estimate Vascular Age from PPG Data: a Novel Digital Biomarker for Cardiovascular Healthcited by 1
- 2024Leveraging Group Classification with Descending Soft Labeling for Deep Imbalanced Regressioncited by 1
- 2025ACCon: Angle-Compensated Contrastive Regularizer for Deep Regressioncited by 1
- 2025Disentangled Deep Smoothed Bootstrap for Fair Imbalanced Regressioncited by 1
- 2025Balanced Sharpness-Aware Minimization for Imbalanced Regressioncited by 1
- 2025SPECTRA: Spectral Domain-Aware Graph Generation for Imbalanced Molecular Property Regressioncited by 1
- 2026Hybrid Imbalanced Regression Through Unified Data-Level and Algorithm-Level Balancingcited by 1
- 2023Learning Subjective Time-Series Data via Utopia Label Distribution Approximationcited by 0
- 2023Noise-in, Bias-out: Balanced and Real-time MoCap Solvingcited by 0
- 2023Survey on Imbalanced Data, Representation Learning and SEP Forecastingcited by 0
- 2025AdaPRL: Adaptive Pairwise Regression Learning with Uncertainty Estimation for Universal Regression Taskscited by 0
- 2025VOCAL: Visual Odometry via ContrAstive Learningcited by 0
- 2025AI-driven Remote Facial Skin Hydration and TEWL Assessment from Selfie Images: A Systematic Solutioncited by 0
- 2025Highly Imbalanced Regression with Tabular Data in SEP and Other Applicationscited by 0
- 2025More Data or Better Algorithms: Latent Diffusion Augmentation for Deep Imbalanced Regressioncited by 0
- 2026LLM-Augmented Computational Phenotyping of Long Covidcited by 0
- 2026Chronological Contrastive Learning: Few-Shot Progression Assessment in Irreversible Diseasescited by 0
- 2026LOPA: Enhancing Spoken Language Assessment via Latent Ordinal Prototype Alignmentcited by 0
- 2026Contrastive Order Learning: A General Framework for Ordinal Regressioncited by 0
- 2026DeMMO: Longitudinal and Cross-Disease Modelling of Digital Mobility Outcomes via Multi-Task Learningcited by 0
- 2026Beyond Homoscedasticity: Decoupled Uncertainty Optimization for Deep Imbalanced Regressioncited by 0
50 most cited of 52 All 52 (JSON)
- 2026Exposing Blind Spots in Deep Imbalanced Regression Evaluation21 Sep 2026
- 2026PhyRestore: Physics-Structured Latent-Factor Restoration17 Sep 2026
- 2026Beyond Homoscedasticity: Decoupled Uncertainty Optimization for Deep Imbalanced Regression4 Sep 2026
- 2026DeMMO: Longitudinal and Cross-Disease Modelling of Digital Mobility Outcomes via Multi-Task Learning25 Aug 2026
- 2026Contrastive Order Learning: A General Framework for Ordinal Regression9 Jul 2026
- 2026LOPA: Enhancing Spoken Language Assessment via Latent Ordinal Prototype Alignment30 Jun 2026
- 2026Hybrid Imbalanced Regression Through Unified Data-Level and Algorithm-Level Balancing31 May 2026
- 2026Chronological Contrastive Learning: Few-Shot Progression Assessment in Irreversible Diseases23 Mar 2026
- 2026LLM-Augmented Computational Phenotyping of Long Covid18 Mar 2026
- 2025SPECTRA: Spectral Domain-Aware Graph Generation for Imbalanced Molecular Property Regression6 Nov 2025
- 2025More Data or Better Algorithms: Latent Diffusion Augmentation for Deep Imbalanced Regression27 Sep 2025
- 2025Highly Imbalanced Regression with Tabular Data in SEP and Other Applications19 Sep 2025
38 more
- 2025AI-driven Remote Facial Skin Hydration and TEWL Assessment from Selfie Images: A Systematic Solution8 Sep 2025
- 2025Balanced Sharpness-Aware Minimization for Imbalanced Regression23 Aug 2025
- 2025Disentangled Deep Smoothed Bootstrap for Fair Imbalanced Regression19 Aug 2025
- 2025VOCAL: Visual Odometry via ContrAstive Learning30 Jun 2025
- 2025CLOC: Contrastive Learning for Ordinal Classification with Multi-Margin N-pair Loss22 Apr 2025
- 2025Improve Representation for Imbalanced Regression through Geometric Constraints2 Mar 2025
- 2025Sample Selection via Contrastive Fragmentation for Noisy Label Regression25 Feb 2025
- 2025Improving Deep Regression with Tightness13 Feb 2025
- 2025A Comprehensive Survey on Imbalanced Data Learning13 Feb 2025
- 2025PoGDiff: Product-of-Gaussians Diffusion Models for Imbalanced Text-to-Image Generation12 Feb 2025
- 2025ACCon: Angle-Compensated Contrastive Regularizer for Deep Regression13 Jan 2025
- 2025AdaPRL: Adaptive Pairwise Regression Learning with Uncertainty Estimation for Universal Regression Tasks10 Jan 2025
- 2024Leveraging Group Classification with Descending Soft Labeling for Deep Imbalanced Regression16 Dec 2024
- 2024Data Augmentation with Variational Autoencoder for Imbalanced Dataset9 Dec 2024
- 2024Dist Loss: Enhancing Regression in Few-Shot Region through Distribution Distance Constraint20 Nov 2024
- 2024Rank and Align: Towards Effective Source-free Graph Domain Adaptation22 Aug 2024
- 2024Deep Imbalanced Regression to Estimate Vascular Age from PPG Data: a Novel Digital Biomarker for Cardiovascular Health21 Jun 2024
- 2024Optimizing Automatic Speech Assessment: W-RankSim Regularization and Hybrid Feature Fusion Strategies16 Jun 2024
- 2024Interpretable Cascading Mixture-of-Experts for Urban Traffic Congestion Prediction14 Jun 2024
- 2024IM-Context: In-Context Learning for Imbalanced Regression Tasks28 May 2024
- 2024Boarding for ISS: Imbalanced Self-Supervised: Discovery of a Scaled Autoencoder for Mixed Tabular Datasets23 Mar 2024
- 2024AFreeCA: Annotation-Free Counting for All7 Mar 2024
- 2024Gradient Aligned Regression via Pairwise Losses8 Feb 2024
- 2024Are we making much progress? Revisiting chemical reaction yield prediction from an imbalanced regression perspective6 Feb 2024
- 2023AdaFlood: Adaptive Flood Regularization6 Nov 2023
- 2023Deep Imbalanced Regression via Hierarchical Classification Adjustment26 Oct 2023
- 2023Survey on Imbalanced Data, Representation Learning and SEP Forecasting11 Oct 2023
- 2023Noise-in, Bias-out: Balanced and Real-time MoCap Solving25 Sep 2023
- 2023ConR: Contrastive Regularizer for Deep Imbalanced Regression13 Sep 2023
- 2023A step towards understanding why classification helps regression21 Aug 2023
- 2023Generalized Oversampling for Learning from Imbalanced datasets and Associated Theory5 Aug 2023
- 2023Continual Learning in Predictive Autoscaling29 Jul 2023
- 2023Learning Subjective Time-Series Data via Utopia Label Distribution Approximation15 Jul 2023
- 2023Learning-to-Rank Meets Language: Boosting Language-Driven Ordering Alignment for Ordinal Classification24 Jun 2023
- 2023Variational Imbalanced Regression: Fair Uncertainty Quantification via Probabilistic Smoothing11 Jun 2023
- 2023Uncertainty Voting Ensemble for Imbalanced Deep Regression24 May 2023
- 2023Semi-Supervised Graph Imbalanced Regression20 May 2023
- 2023Ranking Regularization for Critical Rare Classes: Minimizing False Positives at a High True Positive Rate31 Mar 2023
50 newest of 52 All 52 (JSON)
- 2022Rank-N-Contrast: Learning Continuous Representations for Regressioncited by 76
- 2023Improving Deep Regression with Ordinal Entropycited by 45
- 2023Learning-to-Rank Meets Language: Boosting Language-Driven Ordering Alignment for Ordinal Classificationcited by 21
- 2023ConR: Contrastive Regularizer for Deep Imbalanced Regressioncited by 19
- 2023A step towards understanding why classification helps regressioncited by 15
- 2023Semi-Supervised Graph Imbalanced Regressioncited by 14
- 2024AFreeCA: Annotation-Free Counting for Allcited by 12
- 2025CLOC: Contrastive Learning for Ordinal Classification with Multi-Margin N-pair Losscited by 11
- 2025A Comprehensive Survey on Imbalanced Data Learningcited by 10
- 2023Deep Imbalanced Regression via Hierarchical Classification Adjustmentcited by 9
- 2024IM-Context: In-Context Learning for Imbalanced Regression Taskscited by 7
- 2024Rank and Align: Towards Effective Source-free Graph Domain Adaptationcited by 7
12 most cited of 48 All 48 (JSON)
- 2026Exposing Blind Spots in Deep Imbalanced Regression Evaluation21 Sep 2026
- 2026PhyRestore: Physics-Structured Latent-Factor Restoration17 Sep 2026
- 2026Beyond Homoscedasticity: Decoupled Uncertainty Optimization for Deep Imbalanced Regression4 Sep 2026
- 2026DeMMO: Longitudinal and Cross-Disease Modelling of Digital Mobility Outcomes via Multi-Task Learning25 Aug 2026
- 2026Contrastive Order Learning: A General Framework for Ordinal Regression9 Jul 2026
- 2026Hybrid Imbalanced Regression Through Unified Data-Level and Algorithm-Level Balancing31 May 2026
- 2026Chronological Contrastive Learning: Few-Shot Progression Assessment in Irreversible Diseases23 Mar 2026
- 2026LLM-Augmented Computational Phenotyping of Long Covid18 Mar 2026
- 2025SPECTRA: Spectral Domain-Aware Graph Generation for Imbalanced Molecular Property Regression6 Nov 2025
- 2025Highly Imbalanced Regression with Tabular Data in SEP and Other Applications19 Sep 2025
- 2025AI-driven Remote Facial Skin Hydration and TEWL Assessment from Selfie Images: A Systematic Solution8 Sep 2025
- 2025Balanced Sharpness-Aware Minimization for Imbalanced Regression23 Aug 2025
12 newest of 48 All 48 (JSON)