Unbalanced Optimal Transport: A Unified Framework for Object Detection
Not on the map. Why?
Abstract (arXiv)
During training, supervised object detection tries to correctly match the predicted bounding boxes and associated classification scores to the ground truth. This is essential to determine which predictions are to be pushed towards which solutions, or to be discarded. Popular matching strategies include matching to the closest ground truth box (mostly used in combination with anchors), or matching via the Hungarian algorithm (mostly used in anchor-free methods). Each of these strategies comes with its own properties, underlying losses, and heuristics. We show how Unbalanced Optimal Transport unifies these different approaches and opens a whole continuum of methods in between. This allows for a finer selection of the desired properties. Experimentally, we show that training an object detection model with Unbalanced Optimal Transport is able to reach the state-of-the-art both in terms of Average Precision and Average Recall as well as to provide a faster initial convergence. The approach is well suited for GPU implementation, which proves to be an advantage for large-scale models.
Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Builds on 37 of its 66 references that are in the map. First posted on arXiv 5 Jul 2023.
Builds on
37 of 66 references.
References · 37
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2017Mask R-CNNcited by 7,277
- 2022Generative Adversarial Networkscited by 5,627
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2015SSD: Single Shot MultiBox Detectorcited by 3,130
- 2015Fast R-CNNcited by 2,933
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2017Improved Training of Wasserstein GANscited by 2,235
25 more
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,276
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2018Computational Optimal Transportcited by 780
- 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 720
- 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 573
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 488
- 2016R-FCN: Object Detection via Region-based Fully Convolutional Networkscited by 414
- 2018Deep Learning for Generic Object Detection: A Surveycited by 392
- 2017Wasserstein Auto-Encoderscited by 373
- 2017Learning Generative Models with Sinkhorn Divergencescited by 314
- 2019Libra R-CNN: Towards Balanced Learning for Object Detectioncited by 255
- 2017Near-linear time approximation algorithms for optimal transport via Sinkhorn iterationcited by 223
- 2015Learning with a Wasserstein Losscited by 196
- 2021OTA: Optimal Transport Assignment for Object Detectioncited by 178
- 2021Rethinking Rotated Object Detection with Gaussian Wasserstein Distance Losscited by 156
- 2021Unbalanced minibatch Optimal Transport; applications to Domain Adaptationcited by 125
- 2016Stabilized Sparse Scaling Algorithms for Entropy Regularized Transport Problemscited by 73
- 2015Sliced Wasserstein Kernels for Probability Distributionscited by 65
- 2018On the Latent Space of Wasserstein Auto-Encoderscited by 22
- 2019Screening Sinkhorn Algorithm for Regularized Optimal Transportcited by 20
- 2022Optimal Correction Cost for Object Detection Evaluationcited by 11
- 2020Wasserstein Exponential Kernelscited by 10
Built on by
Citing papers per year: 2024: 3; 2025: 3; 2026: 9.
15 papers.
Sort:
By area:
- 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentationcited by 38
- 2024AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportationcited by 28
- 2025Joint Self-Supervised Video Alignment and Action Segmentationcited by 11
- 2024Any2Graph: Deep End-To-End Supervised Graph Prediction With An Optimal Transport Losscited by 7
- 2026Bridging Vision and Language Concepts through Optimal Transport Semantic Flowcited by 1
- 2026Target-Guided Selective Reweighting for Physics-Informed Neural Network Inverse Problems: A Transfer Learning Approachcited by 1
- 2025Gromov-Wasserstein and optimal transport: from assignment problems to probabilistic numericcited by 0
- 2025Optimal Transport for Handwritten Text Recognition in a Low-Resource Regimecited by 0
- 2026Accelerated Sinkhorn Algorithms for Partial Optimal Transportcited by 0
- 2026Gromov Wasserstein Optimal Transport for Semantic Correspondencescited by 0
- 2026Unbalanced optimal transport for robust longitudinal lesion evolution with registration-aware and appearance-guided priorscited by 0
- 2026Noise-aware few-shot learning through bi-directional multi-view prompt alignmentcited by 0
3 more
- 2026Telescope: Learnable Hyperbolic Foveation for Ultra-Long-Range Object Detectioncited by 0
- 2026OTCHA: Optimal Transport-driven Confidence-aware Latent Hub Alignment for Multi-View Medical Image Classificationcited by 0
- 2026Quantifying Annotation Agreement in Object Detection with Optimal Transportcited by 0
- 2026Quantifying Annotation Agreement in Object Detection with Optimal Transport14 Oct 2026
- 2026Target-Guided Selective Reweighting for Physics-Informed Neural Network Inverse Problems: A Transfer Learning Approach6 Jul 2026
- 2026Bridging Vision and Language Concepts through Optimal Transport Semantic Flow25 Jun 2026
- 2026OTCHA: Optimal Transport-driven Confidence-aware Latent Hub Alignment for Multi-View Medical Image Classification18 Jun 2026
- 2026Telescope: Learnable Hyperbolic Foveation for Ultra-Long-Range Object Detection7 Apr 2026
- 2026Noise-aware few-shot learning through bi-directional multi-view prompt alignment12 Mar 2026
- 2026Unbalanced optimal transport for robust longitudinal lesion evolution with registration-aware and appearance-guided priors10 Feb 2026
- 2026Gromov Wasserstein Optimal Transport for Semantic Correspondences3 Feb 2026
- 2026Accelerated Sinkhorn Algorithms for Partial Optimal Transport23 Jan 2026
- 2025Optimal Transport for Handwritten Text Recognition in a Low-Resource Regime21 Sep 2025
- 2025Gromov-Wasserstein and optimal transport: from assignment problems to probabilistic numeric4 Sep 2025
- 2025Joint Self-Supervised Video Alignment and Action Segmentation21 Mar 2025
3 more
- 2024AWT: Transferring Vision-Language Models via Augmentation, Weighting, and Transportation5 Jul 2024
- 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentation1 Apr 2024
- 2024Any2Graph: Deep End-To-End Supervised Graph Prediction With An Optimal Transport Loss19 Feb 2024
- 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentationcited by 38
- 2025Joint Self-Supervised Video Alignment and Action Segmentationcited by 11
- 2024Any2Graph: Deep End-To-End Supervised Graph Prediction With An Optimal Transport Losscited by 7
- 2026Bridging Vision and Language Concepts through Optimal Transport Semantic Flowcited by 1
- 2026Target-Guided Selective Reweighting for Physics-Informed Neural Network Inverse Problems: A Transfer Learning Approachcited by 1
- 2025Gromov-Wasserstein and optimal transport: from assignment problems to probabilistic numericcited by 0
- 2025Optimal Transport for Handwritten Text Recognition in a Low-Resource Regimecited by 0
- 2026Accelerated Sinkhorn Algorithms for Partial Optimal Transportcited by 0
- 2026Unbalanced optimal transport for robust longitudinal lesion evolution with registration-aware and appearance-guided priorscited by 0
- 2026Telescope: Learnable Hyperbolic Foveation for Ultra-Long-Range Object Detectioncited by 0
- 2026OTCHA: Optimal Transport-driven Confidence-aware Latent Hub Alignment for Multi-View Medical Image Classificationcited by 0
- 2026Quantifying Annotation Agreement in Object Detection with Optimal Transportcited by 0
- 2026Quantifying Annotation Agreement in Object Detection with Optimal Transport14 Oct 2026
- 2026Target-Guided Selective Reweighting for Physics-Informed Neural Network Inverse Problems: A Transfer Learning Approach6 Jul 2026
- 2026Bridging Vision and Language Concepts through Optimal Transport Semantic Flow25 Jun 2026
- 2026OTCHA: Optimal Transport-driven Confidence-aware Latent Hub Alignment for Multi-View Medical Image Classification18 Jun 2026
- 2026Telescope: Learnable Hyperbolic Foveation for Ultra-Long-Range Object Detection7 Apr 2026
- 2026Unbalanced optimal transport for robust longitudinal lesion evolution with registration-aware and appearance-guided priors10 Feb 2026
- 2026Accelerated Sinkhorn Algorithms for Partial Optimal Transport23 Jan 2026
- 2025Optimal Transport for Handwritten Text Recognition in a Low-Resource Regime21 Sep 2025
- 2025Gromov-Wasserstein and optimal transport: from assignment problems to probabilistic numeric4 Sep 2025
- 2025Joint Self-Supervised Video Alignment and Action Segmentation21 Mar 2025
- 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentation1 Apr 2024
- 2024Any2Graph: Deep End-To-End Supervised Graph Prediction With An Optimal Transport Loss19 Feb 2024