mlsanityData to 14 Oct 2026

Temporal Cycle-Consistency Learning

arXiv 1904.07846 ↗First posted 16 Apr 2019cs.CV cs.LGcited by 154

Not on the map. Why?

Abstract (arXiv)

We introduce a self-supervised representation learning method based on the task of temporal alignment between videos. The method trains a network using temporal cycle consistency (TCC), a differentiable cycle-consistency loss that can be used to find correspondences across time in multiple videos. The resulting per-frame embeddings can be used to align videos by simply matching frames using the nearest-neighbors in the learned embedding space. To evaluate the power of the embeddings, we densely label the Pouring and Penn Action video datasets for action phases. We show that (i) the learned embeddings enable few-shot classification of these action phases, significantly reducing the supervised training requirements; and (ii) TCC is complementary to other methods of self-supervised learning in videos, such as Shuffle and Learn and Time-Contrastive Networks. The embeddings are also used for a number of applications based on alignment (dense temporal correspondence) between video pairs, including transfer of metadata of synchronized modalities between videos (sounds, temporal semantic labels), synchronized playback of multiple videos, and anomaly detection. Project webpage: https://sites.google.com/view/temporal-cycle-consistency .

Key facts. Cited by 154 papers in the map (data through 14 Oct 2026). First posted on arXiv 16 Apr 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2020: 1; 2021: 37; 2022: 28; 2023: 29; 2024: 18; 2025: 20; 2026: 21.

154 papers.

Sort:

By area:

  1. 2021With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual Representationscited by 326
  2. 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Playcited by 223
  3. 2022Human-to-Robot Imitation in the Wildcited by 161
  4. 2021VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examplescited by 154
  5. 2021Few-Shot Segmentation via Cycle-Consistent Transformercited by 133
  6. 2020Primal Wasserstein Imitation Learningcited by 121
  7. 2021Efficient Training of Visual Transformers with Small Datasetscited by 108
  8. 2021XIRL: Cross-embodiment Inverse Reinforcement Learningcited by 107
  9. 2023RoboTAP: Tracking Arbitrary Points for Few-Shot Visual Imitationcited by 90
  10. 2022My View is the Best View: Procedure Learning from Egocentric Videoscited by 81
  11. 2021Discrete-time Temporal Network Embedding via Implicit Hierarchical Learning in Hyperbolic Spacecited by 67
  12. 2021Playable Video Generationcited by 64
38 more
  1. 2021Distilling Audio-Visual Knowledge by Compositional Contrastive Learningcited by 53
  2. 2024Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformerscited by 52
  3. 2023CaptainCook4D: A Dataset for Understanding Errors in Procedural Activitiescited by 51
  4. 2021Learning the Predictability of the Futurecited by 49
  5. 2021Unsupervised Action Segmentation by Joint Representation Learning and Online Clusteringcited by 49
  6. 2021Learning by Aligning Videos in Timecited by 48
  7. 2022Graph Inverse Reinforcement Learning from Diverse Videoscited by 46
  8. 2023Learning Fine-grained View-Invariant Representations from Unpaired Ego-Exo Videos via Temporal Alignmentcited by 46
  9. 2021Representation Learning via Global Temporal Alignment and Cycle-Consistencycited by 44
  10. 2024DynaMo: In-Domain Dynamics Pretraining for Visuo-Motor Controlcited by 44
  11. 2021Warp Consistency for Unsupervised Learning of Dense Correspondencescited by 42
  12. 2023Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistencycited by 42
  13. 2021PlayVirtual: Augmenting Cycle-Consistent Virtual Trajectories for Reinforcement Learningcited by 41
  14. 2021Video Contrastive Learning with Global Contextcited by 41
  15. 2023SkeletonMAE: Graph-based Masked Autoencoder for Skeleton Sequence Pre-trainingcited by 41
  16. 2024Learning to Manipulate Anywhere: A Visual Generalizable Framework For Reinforcement Learningcited by 41
  17. 2021Self-Supervised Learning for Semi-Supervised Temporal Action Proposalcited by 39
  18. 2021Drop-DTW: Aligning Common Signal Between Sequences While Dropping Outlierscited by 39
  19. 2022Probabilistic Representations for Video Contrastive Learningcited by 34
  20. 2022Probabilistic Warp Consistency for Weakly-Supervised Semantic Correspondencescited by 30
  21. 2025Seeing the Arrow of Time in Large Multimodal Modelscited by 30
  22. 2021Self-Supervised Representation Learning from Flow Equivariancecited by 28
  23. 2022Frame-wise Action Representations for Long Videos via Sequence Contrastive Learningcited by 27
  24. 2022Locality-Aware Inter-and Intra-Video Reconstruction for Self-Supervised Correspondence Learningcited by 26
  25. 2021Robust Object Detection via Instance-Level Temporal Cycle Confusioncited by 24
  26. 2022ACID: Action-Conditional Implicit Visual Dynamics for Deformable Object Manipulationcited by 24
  27. 2022Learning State-Aware Visual Representations from Audible Interactionscited by 23
  28. 2021Learning to Align Sequential Actions in the Wildcited by 20
  29. 2021Contrastive Learning of Image Representations with Cross-Video Cycle-Consistencycited by 19
  30. 2022Federated Cycling (FedCy): Semi-supervised Federated Learning of Surgical Phasescited by 18
  31. 2022Object Permanence Emerges in a Random Walk along Memorycited by 18
  32. 2023Soft Neighbors are Positive Supporters in Contrastive Visual Representation Learningcited by 18
  33. 2022Exploring Motion Ambiguity and Alignment for High-Quality Video Frame Interpolationcited by 17
  34. 2022Neural Unbalanced Optimal Transport via Cycle-Consistent Semi-Couplingscited by 17
  35. 2023Synchronization is All You Need: Exocentric-to-Egocentric Transfer for Temporal Action Segmentation with Unlabeled Synchronized Video Pairscited by 17
  36. 2022Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detectioncited by 16
  37. 2024A Comprehensive Survey of Cross-Domain Policy Transfer for Embodied Agentscited by 16
  38. 2023Temporal Coherent Test-Time Optimization for Robust Video Classificationcited by 15

50 most cited of 154 All 154 (JSON)