mlsanityData to 7 Oct 2026

Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positives

arXiv 2201.11736 ↗First posted 27 Jan 2022cs.CVcited by 37

Not on the map. Why?

Abstract (arXiv)

This paper introduces Ranking Info Noise Contrastive Estimation (RINCE), a new member in the family of InfoNCE losses that preserves a ranked ordering of positive samples. In contrast to the standard InfoNCE loss, which requires a strict binary separation of the training pairs into similar and dissimilar samples, RINCE can exploit information about a similarity ranking for learning a corresponding embedding space. We show that the proposed loss function learns favorable embeddings compared to the standard InfoNCE whenever at least noisy ranking information can be obtained or when the definition of positives and negatives is blurry. We demonstrate this for a supervised classification task with additional superclass labels and noisy similarity scores. Furthermore, we show that RINCE can also be applied to unsupervised training with experiments on unsupervised representation learning from videos. In particular, the embedding yields higher classification accuracy, retrieval rates and performs better in out-of-distribution detection than the standard InfoNCE loss.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Builds on 40 of its 62 references that are in the map. First posted on arXiv 27 Jan 2022.

Builds on

40 of 62 references.

References · 40

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  7. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  8. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  9. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  10. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  11. 2020Supervised Contrastive Learningcited by 2,803
  12. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
28 more
  1. 2017The Kinetics Human Action Video Datasetcited by 1,894
  2. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
  3. 2020Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hyperspherecited by 1,393
  4. 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
  5. 2019Contrastive Multiview Codingcited by 1,297
  6. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
  7. 2020What Makes for Good Views for Contrastive Learning?cited by 843
  8. 2019Self-Supervised Learning of Pretext-Invariant Representationscited by 806
  9. 2017Can Spatiotemporal 3D CNNs Retrace the History of 2D CNNs and ImageNet?cited by 551
  10. 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
  11. 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
  12. 2019End-to-End Learning of Visual Representations from Uncurated Instructional Videoscited by 506
  13. 2020Understanding the Behaviour of Contrastive Losscited by 397
  14. 2014One weird trick for parallelizing convolutional neural networkscited by 264
  15. 2020Self-supervised Co-training for Video Representation Learningcited by 232
  16. 2021A Large-Scale Study on Unsupervised Spatiotemporal Representation Learningcited by 214
  17. 2020Contrastive Training for Improved Out-of-Distribution Detectioncited by 186
  18. 2021TCLR: Temporal Contrastive Learning for Video Representationcited by 136
  19. 2020Boosting Contrastive Self-Supervised Learning with False Negative Cancellationcited by 119
  20. 2018Deep Metric Learning with Hierarchical Triplet Losscited by 112
  21. 2020What makes instance discrimination good for transfer learning?cited by 111
  22. 2019Unsupervised Learning from Video with Deep Neural Embeddingscited by 29
  23. 2019Self-Supervised Learning of Video-Induced Visual Invariancescited by 29
  24. 2020Unsupervised Video Representation Learning by Bidirectional Feature Predictioncited by 17
  25. 2020Unsupervised Learning of Video Representations via Dense Trajectory Clusteringcited by 11
  26. 2020Representation learning from videos in-the-wild: An object-centric approachcited by 6
  27. 2020Soft Labeling Affects Out-of-Distribution Detection of Deep Neural Networkscited by 5
  28. 2021Semantically-Conditioned Negative Samples for Efficient Contrastive Learningcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 9; 2024: 12; 2025: 9; 2026: 3.

37 papers.

Sort:

By area:

  1. 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
  2. 2024Two Effects, One Trigger: On the Modality Gap, Object Bias, and Information Imbalance in Contrastive Vision-Language Modelscited by 55
  3. 2023Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligencecited by 52
  4. 2023VLCounter: Text-aware Visual Representation for Zero-Shot Object Countingcited by 45
  5. 2025Pulse-PPG: An Open-Source Field-Trained PPG Foundation Model for Wearable Applications Across Lab and Field Settingscited by 35
  6. 2023FOCAL: Contrastive Learning for Multimodal Time-Series Sensing Signals in Factorized Orthogonal Latent Spacecited by 31
  7. 2023Subclass-balancing Contrastive Learning for Long-tailed Recognitioncited by 26
  8. 2024Task-Driven Exploration: Decoupling and Inter-Task Feedback for Joint Moment Retrieval and Highlight Detectioncited by 25
  9. 2022Graph Soft-Contrastive Learning via Neighborhood Rankingcited by 16
  10. 2024Learning Structured Representations with Hyperbolic Embeddingscited by 16
  11. 2024Advancing Myopia To Holism: Fully Contrastive Language-Image Pre-trainingcited by 13
  12. 2023Leveraging Multi-lingual Positive Instances in Contrastive Learning to Improve Sentence Embeddingcited by 9
25 more
  1. 2024mathbbX-Sample Contrastive Loss: Improving Contrastive Learning with Sample Similarity Graphscited by 9
  2. 2025LD-DETR: Loop Decoder DEtection TRansformer for Video Moment Retrieval and Highlight Detectioncited by 8
  3. 2022Self-supervised Learning for Unintentional Action Predictioncited by 7
  4. 2024FFF: Fixing Flawed Foundations in contrastive pre-training results in very strong Vision-Language modelscited by 7
  5. 2024Let Me Finish My Sentence: Video Temporal Grounding with Holistic Text Understandingcited by 7
  6. 2023Towards a Holistic Understanding of Mathematical Questions with Contrastive Pre-trainingcited by 5
  7. 2024Multi-modal Relation Distillation for Unified 3D Representation Learningcited by 5
  8. 2025Decomposition-based multi-scale transformer framework for time series anomaly detectioncited by 5
  9. 2025Rethinking Graph Contrastive Learning through Relative Similarity Preservationcited by 5
  10. 2026From Vicious to Virtuous Cycles: Synergistic Representation Learning for Unsupervised Video Object-Centric Learningcited by 5
  11. 2024Leveraging Label Semantics and Meta-Label Refinement for Multi-Label Question Classificationcited by 4
  12. 2025Snoopy: Effective and Efficient Semantic Join Discovery via Proxy Columnscited by 4
  13. 2024MOOSS: Mask-Enhanced Temporal Contrastive Learning for Smooth State Evolution in Visual Reinforcement Learningcited by 3
  14. 2025On the Utility of Foundation Models for Fast MRI: Vision-Language-Guided Image Reconstructioncited by 3
  15. 2023Graph Ranking Contrastive Learning: A Extremely Simple yet Efficient Methodcited by 2
  16. 2025Reasoning and Learning a Perceptual Metric for Self-Training of Reflective Objects in Bin-Picking with a Low-cost Cameracited by 2
  17. 2022Contrastive Learning for Object Detectioncited by 1
  18. 2023EMMA-X: An EM-like Multilingual Pre-training Algorithm for Cross-lingual Representation Learningcited by 1
  19. 2024SoftCVI: Contrastive variational inference with self-generated soft labelscited by 1
  20. 2022Contrastive Learning for OOD in Object detectioncited by 0
  21. 2024Computer User Interface Understanding. A New Dataset and a Learning Frameworkcited by 0
  22. 2025Shift Detection and Adaptation for Network Intrusion Detectioncited by 0
  23. 2025CroPS: Improving Dense Retrieval with Cross-Perspective Positive Samples in Short-Video Searchcited by 0
  24. 2026Hierarchical Semantic Correlation-Aware Masked Autoencoder for Unsupervised Audio-Visual Representation Learningcited by 0
  25. 2026Multimodal Taxonomic Conditioning for Generative Plankton Imagerycited by 0