Learning Probabilistic Ordinal Embeddings for Uncertainty-Aware Regression
Not on the map. Why?
Abstract (arXiv)
Uncertainty is the only certainty there is. Modeling data uncertainty is essential for regression, especially in unconstrained settings. Traditionally the direct regression formulation is considered and the uncertainty is modeled by modifying the output space to a certain family of probabilistic distributions. On the other hand, classification based regression and ranking based solutions are more popular in practice while the direct regression methods suffer from the limited performance. How to model the uncertainty within the present-day technologies for regression remains an open issue. In this paper, we propose to learn probabilistic ordinal embeddings which represent each data as a multivariate Gaussian distribution rather than a deterministic point in the latent space. An ordinal distribution constraint is proposed to exploit the ordinal nature of regression. Our probabilistic ordinal embeddings can be integrated into popular regression approaches and empower them with the ability of uncertainty estimation. Experimental results show that our approach achieves competitive performance. Code is available at https://github.com/Li-Wanhua/POEs.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). Builds on 27 of its 61 references that are in the map. First posted on arXiv 25 Mar 2021.
Builds on
27 of 61 references.
References · 27
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2016Deep Variational Information Bottleneckcited by 915
- 2017Wasserstein GANcited by 635
- 2017Towards Principled Methods for Training Generative Adversarial Networkscited by 460
- 2019Probabilistic Face Embeddingscited by 171
- 2017Fine-Grained Head Pose Estimation Without Keypointscited by 163
15 more
- 2018Bounding Box Regression with Uncertainty for Accurate Object Detectioncited by 143
- 2020Data Uncertainty Learning in Face Recognitioncited by 134
- 2016Photo Aesthetics Ranking Network with Attributes and Content Adaptationcited by 122
- 2016Deep Label Distribution Learning with Label Ambiguitycited by 104
- 2018Lightweight Probabilistic Deep Networkscited by 77
- 2020SDE-Net: Equipping Deep Neural Networks with Uncertainty Estimatescited by 75
- 2018Modeling Uncertainty with Hedged Instance Embeddingcited by 52
- 2018Efficient Uncertainty Estimation for Semantic Segmentation in Videoscited by 46
- 2019BridgeNet: A Continuity-Aware Probabilistic Network for Age Estimationcited by 39
- 2017Deep Regression Forests for Age Estimationcited by 35
- 2019Mixture Dense Regression for Object Detection and Human Pose Estimationcited by 29
- 2017Label Distribution Learning Forestscited by 25
- 2015An Image is Worth More than a Thousand Favorites: Surfacing the Hidden Beauty of Flickr Picturescited by 18
- 2020Graph-Based Social Relation Reasoningcited by 14
- 2020Graph-based Kinship Reasoning Networkcited by 8
Built on by
Citing papers per year: 2021: 1; 2022: 10; 2023: 8; 2024: 19; 2025: 13; 2026: 7.
58 papers.
Sort:
By area:
- 2022Rank-N-Contrast: Learning Continuous Representations for Regressioncited by 74
- 2022Moving Window Regression: A Novel Approach to Ordinal Regressioncited by 44
- 2022OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regressioncited by 44
- 2024FaceXFormer: A Unified Transformer for Facial Analysiscited by 34
- 2023DARE-GRAM : Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matricescited by 28
- 2022Label2Label: A Language Modeling Framework for Multi-Attribute Learningcited by 23
- 2022COLD Fusion: Calibrated and Ordinal Latent Distribution Fusion for Uncertainty-Aware Multimodal Emotion Recognitioncited by 22
- 2023Learning-to-Rank Meets Language: Boosting Language-Driven Ordering Alignment for Ordinal Classificationcited by 21
- 2024Teach CLIP to Develop a Number Sense for Ordinal Regressioncited by 20
- 2023Ord2Seq: Regarding Ordinal Regression as Label Sequence Predictioncited by 18
- 2024RICA2: Rubric-Informed, Calibrated Assessment of Actionscited by 13
- 2025CLOC: Contrastive Learning for Ordinal Classification with Multi-Margin N-pair Losscited by 11
38 more
- 2022Stating Comparison Score Uncertainty and Verification Decision Confidence Towards Transparent Face Recognitioncited by 9
- 2023Robust Image Ordinal Regression with Controllable Image Generationcited by 8
- 2024Trustworthy Multimodal Fusion for Sentiment Analysis in Ordinal Sentiment Spacecited by 8
- 2023Introspective Deep Metric Learningcited by 7
- 2024Ordinal Multiple-instance Learning for Ulcerative Colitis Severity Estimation with Selective Aggregated Transformercited by 7
- 2024Ordinal Learning: Longitudinal Attention Alignment Model for Predicting Time to Future Breast Cancer Events from Mammogramscited by 6
- 2025A Survey on Ordinal Regression: Applications, Advances and Prospectscited by 5
- 2024DIOR-ViT: Differential Ordinal Learning Vision Transformer for Cancer Classification in Pathology Imagescited by 4
- 2024Uncertainty-Guided Alignment for Unsupervised Domain Adaptation in Regressioncited by 3
- 2024Aligning Vision Models with Human Aesthetics in Retrieval: Benchmarks and Algorithmscited by 3
- 2024Contrastive Learning with Adaptive Neighborhoods for Brain Age Prediction on 3D Stiffness Mapscited by 3
- 2024Self-supervised Auxiliary Learning for Texture and Model-based Hybrid Robust and Fair Featuring in Face Analysiscited by 3
- 2024Ordinal-Aware Calibration for Ordinal Classificationcited by 3
- 2025IMG: Calibrating Diffusion Models via Implicit Multimodal Guidancecited by 3
- 2022Uncertainty Estimation for 3D Dense Prediction via Cross-Point Embeddingscited by 2
- 2022Probabilistic Deep Metric Learning for Hyperspectral Image Classificationcited by 2
- 2023Controlling Class Layout for Deep Ordinal Classification via Constrained Proxies Learningcited by 2
- 2023General vs. Long-Tailed Age Estimation: An Approach to Kill Two Birds with One Stonecited by 2
- 2024Multi-Task Learning Using Uncertainty to Weigh Losses for Heterogeneous Face Attribute Estimationcited by 2
- 2025TabTreeFormer: Tabular Data Generation Using Hybrid Tree-Transformercited by 2
- 2025OrderChain: Towards General Instruct-Tuning for Stimulating the Ordinal Understanding Ability of MLLMcited by 2
- 2025FaceInsight: A Multimodal Large Language Model for Face Perceptioncited by 2
- 2025Parameterized Diffusion Optimization enabled Autoregressive Ordinal Regression for Diabetic Retinopathy Gradingcited by 2
- 2024Beyond the Known: Adversarial Autoencoders in Novelty Detectioncited by 1
- 2024Are They the Same Picture? Adapting Concept Bottleneck Models for Human-AI Collaboration in Image Retrievalcited by 1
- 2025ACCon: Angle-Compensated Contrastive Regularizer for Deep Regressioncited by 1
- 2025Beyond the Horizon: Decoupling Multi-View UAV Action Recognition via Partial Order Transfercited by 1
- 2025Dual-level Fuzzy Learning with Patch Guidance for Image Ordinal Regressioncited by 1
- 2026Learning Ordinal Probabilistic Reward from Preferencescited by 1
- 2021Dense Uncertainty Estimation via an Ensemble-based Conditional Latent Variable Modelcited by 0
- 2022Introspective Deep Metric Learning for Image Retrievalcited by 0
- 2022Angular triangle distance for ordinal metric learningcited by 0
- 2023CORE: Learning Consistent Ordinal REpresentations for Image Ordinal Estimationcited by 0
- 2024DOR3D-Net: Dense Ordinal Regression Network for 3D Hand Pose Estimationcited by 0
- 2024Uncertainty-oriented Order Learning for Facial Beauty Predictioncited by 0
- 2024Self-Relaxed Joint Training: Sample Selection for Severity Estimation with Ordinal Noisy Labelscited by 0
- 2024Symmetric Perception and Ordinal Regression for Detecting Scoliosis Natural Imagecited by 0
- 2025Identifying Trustworthiness Challenges in Deep Learning Models for Continental-Scale Water Quality Predictioncited by 0
50 most cited of 58 All 58 (JSON)
- 2026DisMix: Order-Aware Mixup for Medical Imaging via Disentangling Ordinal and Non-Ordinal Features5 Aug 2026
- 2026D3O: Dynamic Distribution Distillation for Ordinal Regression26 Jul 2026
- 2026Contrastive Order Learning: A General Framework for Ordinal Regression9 Jul 2026
- 2026Stochastic Order Learning: An Approach to Rank Estimation Using Noisy Data9 Jul 2026
- 2026A Backbone Benchmarking Study on Self-supervised Learning as a Auxiliary Task with Texture-based Local Descriptors for Face Analysis23 Mar 2026
- 2026Directed Ordinal Diffusion Regularization for Progression-Aware Diabetic Retinopathy Grading25 Feb 2026
- 2026Learning Ordinal Probabilistic Reward from Preferences13 Feb 2026
- 2025Beyond Memorization: A Multi-Modal Ordinal Regression Benchmark to Expose Popularity Bias in Vision-Language Models24 Dec 2025
- 2025IMG: Calibrating Diffusion Models via Implicit Multimodal Guidance30 Sep 2025
- 2025Parameterized Diffusion Optimization enabled Autoregressive Ordinal Regression for Diabetic Retinopathy Grading7 Jul 2025
- 2025STORM: Benchmarking Visual Rating of MLLMs with a Comprehensive Ordinal Regression Dataset2 Jun 2025
- 2025Dual-level Fuzzy Learning with Patch Guidance for Image Ordinal Regression9 May 2025
38 more
- 2025Beyond the Horizon: Decoupling Multi-View UAV Action Recognition via Partial Order Transfer29 Apr 2025
- 2025CLOC: Contrastive Learning for Ordinal Classification with Multi-Margin N-pair Loss22 Apr 2025
- 2025FaceInsight: A Multimodal Large Language Model for Face Perception22 Apr 2025
- 2025OrderChain: Towards General Instruct-Tuning for Stimulating the Ordinal Understanding Ability of MLLM7 Apr 2025
- 2025Identifying Trustworthiness Challenges in Deep Learning Models for Continental-Scale Water Quality Prediction13 Mar 2025
- 2025A Survey on Ordinal Regression: Applications, Advances and Prospects2 Mar 2025
- 2025ACCon: Angle-Compensated Contrastive Regularizer for Deep Regression13 Jan 2025
- 2025TabTreeFormer: Tabular Data Generation Using Hybrid Tree-Transformer2 Jan 2025
- 2024Symmetric Perception and Ordinal Regression for Detecting Scoliosis Natural Image24 Nov 2024
- 2024Ordinal Multiple-instance Learning for Ulcerative Colitis Severity Estimation with Selective Aggregated Transformer22 Nov 2024
- 2024Self-Relaxed Joint Training: Sample Selection for Severity Estimation with Ordinal Noisy Labels29 Oct 2024
- 2024Ordinal-Aware Calibration for Ordinal Classification21 Oct 2024
- 2024Self-supervised Auxiliary Learning for Texture and Model-based Hybrid Robust and Fair Featuring in Face Analysis29 Sep 2024
- 2024Ordinal Learning: Longitudinal Attention Alignment Model for Predicting Time to Future Breast Cancer Events from Mammograms10 Sep 2024
- 2024Uncertainty-oriented Order Learning for Facial Beauty Prediction1 Sep 2024
- 2024Teach CLIP to Develop a Number Sense for Ordinal Regression7 Aug 2024
- 2024RICA2: Rubric-Informed, Calibrated Assessment of Actions4 Aug 2024
- 2024Contrastive Learning with Adaptive Neighborhoods for Brain Age Prediction on 3D Stiffness Maps1 Aug 2024
- 2024Are They the Same Picture? Adapting Concept Bottleneck Models for Human-AI Collaboration in Image Retrieval12 Jul 2024
- 2024DIOR-ViT: Differential Ordinal Learning Vision Transformer for Cancer Classification in Pathology Images10 Jul 2024
- 2024Aligning Vision Models with Human Aesthetics in Retrieval: Benchmarks and Algorithms13 Jun 2024
- 2024Trustworthy Multimodal Fusion for Sentiment Analysis in Ordinal Sentiment Space13 Apr 2024
- 2024Beyond the Known: Adversarial Autoencoders in Novelty Detection6 Apr 2024
- 2024DOR3D-Net: Dense Ordinal Regression Network for 3D Hand Pose Estimation20 Mar 2024
- 2024FaceXFormer: A Unified Transformer for Facial Analysis19 Mar 2024
- 2024Multi-Task Learning Using Uncertainty to Weigh Losses for Heterogeneous Face Attribute Estimation1 Mar 2024
- 2024Uncertainty-Guided Alignment for Unsupervised Domain Adaptation in Regression24 Jan 2024
- 2023Introspective Deep Metric Learning11 Sep 2023
- 2023General vs. Long-Tailed Age Estimation: An Approach to Kill Two Birds with One Stone19 Jul 2023
- 2023Ord2Seq: Regarding Ordinal Regression as Label Sequence Prediction18 Jul 2023
- 2023Learning-to-Rank Meets Language: Boosting Language-Driven Ordering Alignment for Ordinal Classification24 Jun 2023
- 2023Robust Image Ordinal Regression with Controllable Image Generation7 May 2023
- 2023DARE-GRAM : Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matrices23 Mar 2023
- 2023Controlling Class Layout for Deep Ordinal Classification via Constrained Proxies Learning1 Mar 2023
- 2023CORE: Learning Consistent Ordinal REpresentations for Image Ordinal Estimation15 Jan 2023
- 2022Angular triangle distance for ordinal metric learning28 Nov 2022
- 2022Probabilistic Deep Metric Learning for Hyperspectral Image Classification15 Nov 2022
- 2022Stating Comparison Score Uncertainty and Verification Decision Confidence Towards Transparent Face Recognition19 Oct 2022
50 newest of 58 All 58 (JSON)
- 2025OrderChain: Towards General Instruct-Tuning for Stimulating the Ordinal Understanding Ability of MLLMcited by 2
- 2025FaceInsight: A Multimodal Large Language Model for Face Perceptioncited by 2
- 2025Beyond Memorization: A Multi-Modal Ordinal Regression Benchmark to Expose Popularity Bias in Vision-Language Modelscited by 0
- 2025Beyond Memorization: A Multi-Modal Ordinal Regression Benchmark to Expose Popularity Bias in Vision-Language Models24 Dec 2025
- 2025FaceInsight: A Multimodal Large Language Model for Face Perception22 Apr 2025
- 2025OrderChain: Towards General Instruct-Tuning for Stimulating the Ordinal Understanding Ability of MLLM7 Apr 2025
- 2022Rank-N-Contrast: Learning Continuous Representations for Regressioncited by 74
- 2022Moving Window Regression: A Novel Approach to Ordinal Regressioncited by 44
- 2022OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal Regressioncited by 44
- 2024FaceXFormer: A Unified Transformer for Facial Analysiscited by 34
- 2023DARE-GRAM : Unsupervised Domain Adaptation Regression by Aligning Inverse Gram Matricescited by 28
- 2022Label2Label: A Language Modeling Framework for Multi-Attribute Learningcited by 23
- 2022COLD Fusion: Calibrated and Ordinal Latent Distribution Fusion for Uncertainty-Aware Multimodal Emotion Recognitioncited by 22
- 2023Learning-to-Rank Meets Language: Boosting Language-Driven Ordering Alignment for Ordinal Classificationcited by 21
- 2024Teach CLIP to Develop a Number Sense for Ordinal Regressioncited by 20
- 2023Ord2Seq: Regarding Ordinal Regression as Label Sequence Predictioncited by 18
- 2024RICA2: Rubric-Informed, Calibrated Assessment of Actionscited by 13
- 2025CLOC: Contrastive Learning for Ordinal Classification with Multi-Margin N-pair Losscited by 11
12 most cited of 52 All 52 (JSON)
- 2026DisMix: Order-Aware Mixup for Medical Imaging via Disentangling Ordinal and Non-Ordinal Features5 Aug 2026
- 2026D3O: Dynamic Distribution Distillation for Ordinal Regression26 Jul 2026
- 2026Contrastive Order Learning: A General Framework for Ordinal Regression9 Jul 2026
- 2026Stochastic Order Learning: An Approach to Rank Estimation Using Noisy Data9 Jul 2026
- 2026A Backbone Benchmarking Study on Self-supervised Learning as a Auxiliary Task with Texture-based Local Descriptors for Face Analysis23 Mar 2026
- 2026Directed Ordinal Diffusion Regularization for Progression-Aware Diabetic Retinopathy Grading25 Feb 2026
- 2025Parameterized Diffusion Optimization enabled Autoregressive Ordinal Regression for Diabetic Retinopathy Grading7 Jul 2025
- 2025STORM: Benchmarking Visual Rating of MLLMs with a Comprehensive Ordinal Regression Dataset2 Jun 2025
- 2025Dual-level Fuzzy Learning with Patch Guidance for Image Ordinal Regression9 May 2025
- 2025Beyond the Horizon: Decoupling Multi-View UAV Action Recognition via Partial Order Transfer29 Apr 2025
- 2025CLOC: Contrastive Learning for Ordinal Classification with Multi-Margin N-pair Loss22 Apr 2025
- 2025Identifying Trustworthiness Challenges in Deep Learning Models for Continental-Scale Water Quality Prediction13 Mar 2025
12 newest of 52 All 52 (JSON)