Cycle-Contrast for Self-Supervised Video Representation Learning
Not on the map. Why?
Abstract (arXiv)
We present Cycle-Contrastive Learning (CCL), a novel self-supervised method for learning video representation. Following a nature that there is a belong and inclusion relation of video and its frames, CCL is designed to find correspondences across frames and videos considering the contrastive representation in their domains respectively. It is different from recent approaches that merely learn correspondences across frames or clips. In our method, the frame and video representations are learned from a single network based on an R3D architecture, with a shared non-linear transformation for embedding both frame and video features before the cycle-contrastive loss. We demonstrate that the video representation learned by CCL can be transferred well to downstream tasks of video understanding, outperforming previous methods in nearest neighbour retrieval and action recognition tasks on UCF101, HMDB51 and MMAct.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 10; 2023: 4; 2024: 4; 2025: 0; 2026: 2.
34 papers.
Sort:
- 2022Bridging Video-text Retrieval with Multiple Choice Questionscited by 79
- 2021Motion-aware Contrastive Video Representation Learning via Foreground-background Mergingcited by 45
- 2021PlayVirtual: Augmenting Cycle-Consistent Virtual Trajectories for Reinforcement Learningcited by 41
- 2021Revitalizing CNN Attentions via Transformers in Self-Supervised Visual Representation Learningcited by 34
- 2022MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrievalcited by 29
- 2024Universal Time-Series Representation Learning: A Surveycited by 28
- 2021Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimizationcited by 27
- 2021Cross-modal Knowledge Distillation for Vision-to-Sensor Action Recognitioncited by 25
- 2022Motion-Focused Contrastive Learning of Video Representationscited by 23
- 2022C2F-TCN: A Framework for Semi and Fully Supervised Temporal Action Segmentationcited by 23
- 2021Contrastive Learning of Image Representations with Cross-Video Cycle-Consistencycited by 19
- 2021Iterative Contrast-Classify For Semi-supervised Temporal Action Segmentationcited by 19
22 more
- 2021Motion-Augmented Self-Training for Video Recognition at Smaller Scalecited by 17
- 2022Learning from Untrimmed Videos: Self-Supervised Video Representation Learning with Hierarchical Consistencycited by 15
- 2022Dual Contrastive Learning for Spatio-temporal Representationcited by 15
- 2021Contrastive Spatio-Temporal Pretext Learning for Self-supervised Video Representationcited by 11
- 2023Self-Supervised Video Representation Learning via Latent Time Navigationcited by 11
- 2023Self-Supervised Representation Learning from Temporal Ordering of Automated Driving Sequencescited by 9
- 2023Fine-Grained Spatiotemporal Motion Alignment for Contrastive Video Representation Learningcited by 7
- 2021Contrastive Learning of Global-Local Video Representationscited by 6
- 2021Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrastingcited by 6
- 2022Progressive Cross-modal Knowledge Distillation for Human Action Recognitioncited by 6
- 2021Inter-intra Variant Dual Representations forSelf-supervised Video Recognitioncited by 5
- 2024Contrastive Learning of Person-independent Representations for Facial Action Unit Detectioncited by 5
- 2023CycleCL: Self-supervised Learning for Periodic Videoscited by 4
- 2022Motion Aware Self-Supervision for Generic Event Boundary Detectioncited by 3
- 2021ParamCrop: Parametric Cubic Cropping for Video Contrastive Learningcited by 2
- 2024Learning Contrastive Feature Representations for Facial Action Unit Detectioncited by 2
- 2021Exploring the Diversity and Invariance in Yourself for Visual Pre-Training Taskcited by 1
- 2022Temporal Contrastive Learning with Curriculumcited by 1
- 2022Self-supervised and Weakly Supervised Contrastive Learning for Frame-wise Action Representationscited by 1
- 2024Semi-Supervised Weed Detection for Rapid Deployment and Enhanced Efficiencycited by 1
- 2026Factorized Latent Dynamics for Video JEPA: An Empirical Study of Auxiliary Objectivescited by 0
- 2026`Attention-Guided Cross-Temporal Clustering for Self-Supervised Video Object Segmentationcited by 0
- 2026`Attention-Guided Cross-Temporal Clustering for Self-Supervised Video Object Segmentation8 Jul 2026
- 2026Factorized Latent Dynamics for Video JEPA: An Empirical Study of Auxiliary Objectives16 May 2026
- 2024Semi-Supervised Weed Detection for Rapid Deployment and Enhanced Efficiency12 May 2024
- 2024Contrastive Learning of Person-independent Representations for Facial Action Unit Detection6 Mar 2024
- 2024Learning Contrastive Feature Representations for Facial Action Unit Detection9 Feb 2024
- 2024Universal Time-Series Representation Learning: A Survey8 Jan 2024
- 2023CycleCL: Self-supervised Learning for Periodic Videos5 Nov 2023
- 2023Fine-Grained Spatiotemporal Motion Alignment for Contrastive Video Representation Learning1 Sep 2023
- 2023Self-Supervised Video Representation Learning via Latent Time Navigation10 May 2023
- 2023Self-Supervised Representation Learning from Temporal Ordering of Automated Driving Sequences17 Feb 2023
- 2022C2F-TCN: A Framework for Semi and Fully Supervised Temporal Action Segmentation20 Dec 2022
- 2022Self-supervised and Weakly Supervised Contrastive Learning for Frame-wise Action Representations6 Dec 2022
22 more
- 2022Motion Aware Self-Supervision for Generic Event Boundary Detection11 Oct 2022
- 2022Temporal Contrastive Learning with Curriculum2 Sep 2022
- 2022Progressive Cross-modal Knowledge Distillation for Human Action Recognition17 Aug 2022
- 2022Dual Contrastive Learning for Spatio-temporal Representation12 Jul 2022
- 2022MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval26 Apr 2022
- 2022Learning from Untrimmed Videos: Self-Supervised Video Representation Learning with Hierarchical Consistency6 Apr 2022
- 2022Bridging Video-text Retrieval with Multiple Choice Questions13 Jan 2022
- 2022Motion-Focused Contrastive Learning of Video Representations11 Jan 2022
- 2021Contrastive Spatio-Temporal Pretext Learning for Self-supervised Video Representation16 Dec 2021
- 2021Iterative Contrast-Classify For Semi-supervised Temporal Action Segmentation2 Dec 2021
- 2021Revitalizing CNN Attentions via Transformers in Self-Supervised Visual Representation Learning11 Oct 2021
- 2021Cross-modal Knowledge Distillation for Vision-to-Sensor Action Recognition8 Oct 2021
- 2021Motion-aware Contrastive Video Representation Learning via Foreground-background Merging30 Sep 2021
- 2021ParamCrop: Parametric Cubic Cropping for Video Contrastive Learning24 Aug 2021
- 2021Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimization4 Aug 2021
- 2021Inter-intra Variant Dual Representations forSelf-supervised Video Recognition2 Jul 2021
- 2021Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting18 Jun 2021
- 2021PlayVirtual: Augmenting Cycle-Consistent Virtual Trajectories for Reinforcement Learning8 Jun 2021
- 2021Exploring the Diversity and Invariance in Yourself for Visual Pre-Training Task1 Jun 2021
- 2021Contrastive Learning of Image Representations with Cross-Video Cycle-Consistency13 May 2021
- 2021Motion-Augmented Self-Training for Video Recognition at Smaller Scale4 May 2021
- 2021Contrastive Learning of Global-Local Video Representations7 Apr 2021
- 2022Bridging Video-text Retrieval with Multiple Choice Questionscited by 79
- 2021Motion-aware Contrastive Video Representation Learning via Foreground-background Mergingcited by 45
- 2021PlayVirtual: Augmenting Cycle-Consistent Virtual Trajectories for Reinforcement Learningcited by 41
- 2021Revitalizing CNN Attentions via Transformers in Self-Supervised Visual Representation Learningcited by 34
- 2022MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrievalcited by 29
- 2024Universal Time-Series Representation Learning: A Surveycited by 28
- 2021Enhancing Self-supervised Video Representation Learning via Multi-level Feature Optimizationcited by 27
- 2021Cross-modal Knowledge Distillation for Vision-to-Sensor Action Recognitioncited by 25
- 2022Motion-Focused Contrastive Learning of Video Representationscited by 23
- 2022C2F-TCN: A Framework for Semi and Fully Supervised Temporal Action Segmentationcited by 23
- 2021Contrastive Learning of Image Representations with Cross-Video Cycle-Consistencycited by 19
- 2021Iterative Contrast-Classify For Semi-supervised Temporal Action Segmentationcited by 19
12 most cited of 34 All 34 (JSON)
- 2026`Attention-Guided Cross-Temporal Clustering for Self-Supervised Video Object Segmentation8 Jul 2026
- 2026Factorized Latent Dynamics for Video JEPA: An Empirical Study of Auxiliary Objectives16 May 2026
- 2024Semi-Supervised Weed Detection for Rapid Deployment and Enhanced Efficiency12 May 2024
- 2024Contrastive Learning of Person-independent Representations for Facial Action Unit Detection6 Mar 2024
- 2024Learning Contrastive Feature Representations for Facial Action Unit Detection9 Feb 2024
- 2024Universal Time-Series Representation Learning: A Survey8 Jan 2024
- 2023CycleCL: Self-supervised Learning for Periodic Videos5 Nov 2023
- 2023Fine-Grained Spatiotemporal Motion Alignment for Contrastive Video Representation Learning1 Sep 2023
- 2023Self-Supervised Video Representation Learning via Latent Time Navigation10 May 2023
- 2023Self-Supervised Representation Learning from Temporal Ordering of Automated Driving Sequences17 Feb 2023
- 2022C2F-TCN: A Framework for Semi and Fully Supervised Temporal Action Segmentation20 Dec 2022
- 2022Self-supervised and Weakly Supervised Contrastive Learning for Frame-wise Action Representations6 Dec 2022
12 newest of 34 All 34 (JSON)