mlsanityData to 7 Oct 2026

Nearest-Neighbor Inter-Intra Contrastive Learning from Unlabeled Videos

arXiv 2303.07317 ↗First posted 13 Mar 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Contrastive learning has recently narrowed the gap between self-supervised and supervised methods in image and video domain. State-of-the-art video contrastive learning methods such as CVRL and ρ-MoCo spatiotemporally augment two clips from the same video as positives. By only sampling positive clips locally from a single video, these methods neglect other semantically related videos that can also be useful. To address this limitation, we leverage nearest-neighbor videos from the global space as additional positive pairs, thus improving positive key diversity and introducing a more relaxed notion of similarity that extends beyond video and even class boundaries. Our method, Inter-Intra Video Contrastive Learning (IIVCL), improves performance on a range of video tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 60 of its 74 references that are in the map. First posted on arXiv 13 Mar 2023.

Builds on

60 of 74 references.

References · 60

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  5. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  6. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  7. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  8. 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
  9. 2020Exploring Simple Siamese Representation Learningcited by 2,853
  10. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  11. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  12. 2017The Kinetics Human Action Video Datasetcited by 1,894
38 more
  1. 2018SlowFast Networks for Video Recognitioncited by 1,862
  2. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  3. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
  4. 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
  5. 2019Contrastive Multiview Codingcited by 1,297
  6. 2016Colorful Image Colorizationcited by 1,113
  7. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,092
  8. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
  9. 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 916
  10. 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
  11. 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
  12. 2015Unsupervised Learning of Video Representations using LSTMscited by 434
  13. 2020Spatiotemporal Contrastive Video Representation Learningcited by 372
  14. 2020Debiased Contrastive Learningcited by 354
  15. 2021With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representationscited by 324
  16. 2019Learning Correspondence from the Cycle-Consistency of Timecited by 269
  17. 2019Revisiting Self-Supervised Visual Representation Learningcited by 250
  18. 2020Space-Time Correspondence as a Contrastive Random Walkcited by 239
  19. 2020Self-supervised Co-training for Video Representation Learningcited by 232
  20. 2020What Should Not Be Contrastive in Contrastive Learningcited by 224
  21. 2017Unsupervised Representation Learning by Sorting Sequencescited by 219
  22. 2021A Large-Scale Study on Unsupervised Spatiotemporal Representation Learningcited by 214
  23. 2020MovieNet: A Holistic Dataset for Movie Understandingcited by 206
  24. 2019Local Aggregation for Unsupervised Learning of Visual Embeddingscited by 204
  25. 2020Audio-Visual Instance Discrimination with Cross-Modal Agreementcited by 192
  26. 2019Video Representation Learning by Dense Predictive Codingcited by 175
  27. 2020SpeedNet: Learning the Speediness in Videoscited by 171
  28. 2021VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examplescited by 154
  29. 2018Self-Supervised Video Representation Learning with Space-Time Cubic Puzzlescited by 149
  30. 2020Self-supervised Video Representation Learning by Pace Predictioncited by 139
  31. 2020Memory-augmented Dense Predictive Coding for Video Representation Learningcited by 137
  32. 2021TCLR: Temporal Contrastive Learning for Video Representationcited by 136
  33. 2017Representation Learning by Learning to Countcited by 120
  34. 2021Broaden Your Views for Self-Supervised Video Learningcited by 108
  35. 2019Self-supervised Spatio-temporal Representation Learning for Videos by Predicting Motion and Appearance Statisticscited by 92
  36. 2020A Comprehensive Study of Deep Video Action Recognitioncited by 87
  37. 2020How Useful is Self-Supervised Pretraining for Visual Tasks?cited by 80
  38. 2018Self-Supervised Spatiotemporal Feature Learning via Video Rotation Predictioncited by 71

50 most cited of 60 All 60 (JSON)

Built on by

Not cited yet.