Positive Pair Geometry Matters: Optimal Transport for Contrastive Learning of Visual Representations
Not on the map. Why?
Abstract (arXiv)
Contrastive self-supervised learning has achieved strong performance by learning representations from multiple augmented views of the same image. However, most existing methods construct positive pairs using independently sampled stochastic augmentations, which may alter semantic content and ignore the intrinsic geometry of the data distribution. In this work, we propose OTCLR, an optimal transport-aware framework for contrastive learning representations that generates geometry-consistent positive samples. Instead of directly contrasting two randomly augmented views, we construct intermediate views between the original image and its augmented variants through entropic optimal-transport displacement interpolation. These transport-interpolated samples serve as positive views that better preserve image structure while explicitly modeling spatial distributional geometry. To further promote smooth representation learning, we evaluate auxiliary Sinkhorn regularization terms that encourage transport-interpolated views to remain consistent with their endpoint images. The proposed method can be incorporated into standard contrastive learning pipelines without modifying the encoder architecture. Experiments on multiple benchmark datasets show that our approach improves representation quality and transfer learning performance compared with conventional augmentation-based contrastive learning baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 33 references that are in the map. First posted on arXiv 21 Sep 2026.
Builds on
16 of 33 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2025DINOv3cited by 1,414
- 2020What Makes for Good Views for Contrastive Learning?cited by 846
- 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
4 more
- 2020Understanding the Behaviour of Contrastive Losscited by 398
- 2020Softmax Splatting for Video Frame Interpolationcited by 279
- 2013Fast Computation of Wasserstein Barycenterscited by 216
- 2024Optimal Transport-Based Displacement Interpolation with Data Augmentation for Reduced Order Modeling of Nonlinear Dynamical Systemscited by 3
Built on by
Not cited yet.