mlsanityData to 14 Oct 2026

Cross and Learn: Cross-Modal Self-Supervision

arXiv 1811.03879 ↗First posted 9 Nov 2018cs.CVcited by 34

Not on the map. Why?

Abstract (arXiv)

In this paper we present a self-supervised method for representation learning utilizing two different modalities. Based on the observation that cross-modal information has a high semantic meaning we propose a method to effectively exploit this signal. For our approach we utilize video data since it is available on a large scale and provides easily accessible modalities given by RGB and optical flow. We demonstrate state-of-the-art performance on highly contested action recognition datasets in the context of self-supervised learning. We show that our feature representation also transfers to other tasks and conduct extensive ablation studies to validate our core contributions. Code and model can be found at https://github.com/nawidsayed/Cross-and-Learn.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Nov 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 17; 2022: 7; 2023: 4; 2024: 3; 2025: 2; 2026: 1.

34 papers.

Sort:

By area:

  1. 2021Transformers in Vision: A Surveycited by 1,013
  2. 2021Home Action Genome: Cooperative Compositional Action Understandingcited by 53
  3. 2021Cross-modal Learning for Domain Adaptation in 3D Semantic Segmentationcited by 40
  4. 2025Multimodal Fusion and Vision-Language Models: A Survey for Robot Visioncited by 40
  5. 2021Bridging the Gap between Events and Frames through Unsupervised Domain Adaptationcited by 37
  6. 2021ContIG: Self-supervised Multimodal Contrastive Learning for Medical Imaging with Geneticscited by 36
  7. 2021Hop-Count Based Self-Supervised Anomaly Detection on Attributed Networkscited by 31
  8. 2022Self-supervised Transformer for Deepfake Detectioncited by 22
  9. 2021Contrastive Learning of Image Representations with Cross-Video Cycle-Consistencycited by 19
  10. 2021Motion-Augmented Self-Training for Video Recognition at Smaller Scalecited by 17
  11. 2022Cross-Modal Knowledge Transfer Without Task-Relevant Source Datacited by 17
  12. 2024A Survey of Generative Techniques for Spatial-Temporal Data Miningcited by 14
22 more
  1. 2021CoCon: Cooperative-Contrastive Learningcited by 11
  2. 2024Vision transformers in domain adaptation and domain generalization: a study of robustnesscited by 11
  3. 2021MaCLR: Motion-aware Contrastive Learning of Representations for Videoscited by 10
  4. 2022SS-3DCapsNet: Self-supervised 3D Capsule Networks for Medical Segmentation on Less Labeled Datacited by 10
  5. 2023Prospective Role of Foundation Models in Advancing Autonomous Vehiclescited by 7
  6. 2021Self-Supervised Learning via multi-Transformation Classification for Action Recognitioncited by 5
  7. 2022Modeling Multiple Views via Implicitly Preserving Global Consistency and Local Complementaritycited by 5
  8. 2023A Large-Scale Analysis on Self-Supervised Video Representation Learningcited by 5
  9. 2022Going Deeper into Recognizing Actions in Dark Environments: A Comprehensive Benchmark Studycited by 4
  10. 2024Source-Free Cross-Modal Knowledge Transfer by Unleashing the Potential of Task-Irrelevant Datacited by 4
  11. 2021Self-Supervised Multi-View Learning via Auto-Encoding 3D Transformationscited by 3
  12. 2022Multimodality Multi-Lead ECG Arrhythmia Classification using Self-Supervised Learningcited by 3
  13. 2025A Large-Scale Analysis on Contextual Self-Supervised Video Representation Learningcited by 3
  14. 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Surveycited by 3
  15. 2021Cross-modal Image Retrieval with Deep Mutual Information Maximizationcited by 2
  16. 2021PreViTS: Contrastive Pretraining with Video Tracking Supervisioncited by 2
  17. 2021Information Theory-Guided Heuristic Progressive Multi-View Codingcited by 1
  18. 2021Feature-Supervised Action Modality Transfercited by 0
  19. 2021Self-Supervised Visual Representation Learning Using Lightweight Architecturescited by 0
  20. 2022How do Cross-View and Cross-Modal Alignment Affect Representations in Contrastive Learning?cited by 0
  21. 2023Self-Supervised Learning for Point Clouds Data: A Surveycited by 0
  22. 2023Information Theory-Guided Heuristic Progressive Multi-View Codingcited by 0