mlsanityData to 14 Oct 2026

UMCL: Unimodal-generated Multimodal Contrastive Learning for Cross-compression-rate Deepfake Detection

arXiv 2511.18983 ↗First posted 24 Nov 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

In deepfake detection, the varying degrees of compression employed by social media platforms pose significant challenges for model generalization and reliability. Although existing methods have progressed from single-modal to multimodal approaches, they face critical limitations: single-modal methods struggle with feature degradation under data compression in social media streaming, while multimodal approaches require expensive data collection and labeling and suffer from inconsistent modal quality or accessibility in real-world scenarios. To address these challenges, we propose a novel Unimodal-generated Multimodal Contrastive Learning (UMCL) framework for robust cross-compression-rate (CCR) deepfake detection. In the training stage, our approach transforms a single visual modality into three complementary features: compression-robust rPPG signals, temporal landmark dynamics, and semantic embeddings from pre-trained vision-language models. These features are explicitly aligned through an affinity-driven semantic alignment (ASA) strategy, which models inter-modal relationships through affinity matrices and optimizes their consistency through contrastive learning. Subsequently, our cross-quality similarity learning (CQSL) strategy enhances feature robustness across compression rates. Extensive experiments demonstrate that our method achieves superior performance across various compression rates and manipulation types, establishing a new benchmark for robust deepfake detection. Notably, our approach maintains high detection accuracy even when individual features degrade, while providing interpretable insights into feature relationships through explicit alignment.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 48 of its 66 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

48 of 66 references.

References · 48

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2022Generative Adversarial Networkscited by 5,627
  5. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,433
  6. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
  7. 2016Joint Face Detection and Alignment using Multi-task Cascaded Convolutional Networkscited by 903
  8. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 763
  9. 2019Celeb-DF: A Large-scale Challenging Dataset for DeepFake Forensicscited by 575
  10. 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
  11. 2019Face X-ray for More General Face Forgery Detectioncited by 470
  12. 2018MesoNet: a Compact Facial Video Forgery Detection Networkcited by 409
36 more
  1. 2021Multi-attentional Deepfake Detectioncited by 341
  2. 2018Exposing DeepFake Videos By Detecting Face Warping Artifactscited by 319
  3. 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
  4. 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
  5. 2021Spatial-Phase Shallow Learning: Rethinking Face Forgery Detection in Frequency Domaincited by 244
  6. 2020Two-branch Recurrent Network for Isolating Deepfakes in Videoscited by 161
  7. 2019Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videoscited by 130
  8. 2020Intriguing Properties of Contrastive Lossescited by 130
  9. 2019Remote Photoplethysmograph Signal Measurement from Facial Videos Using Spatio-Temporal Networkscited by 128
  10. 2022Implicit Identity Leakage: The Stumbling Block to Improving Deepfake Detection Generalizationcited by 123
  11. 2021PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformercited by 120
  12. 2021M2TR: Multi-modal Multi-scale Transformers for Deepfake Detectioncited by 114
  13. 2021Local Relation Learning for Face Forgery Detectioncited by 100
  14. 2021Dual Contrastive Learning for General Face Forgery Detectioncited by 100
  15. 2023TALL: Thumbnail Layout for Deepfake Video Detectioncited by 100
  16. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
  17. 2021Spatiotemporal Inconsistency Learning for DeepFake Video Detectioncited by 88
  18. 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
  19. 2022UIA-ViT: Unsupervised Inconsistency-Aware Method based on Vision Transformer for Face Forgery Detectioncited by 69
  20. 2020Exposing GAN-generated Faces Using Inconsistent Corneal Specular Highlightscited by 59
  21. 2018VIPL-HR: A Multi-modal Database for Pulse Estimation from Less-constrained Face Videocited by 58
  22. 2021Improving the Efficiency and Robustness of Deepfakes Detection through Precise Geometric Featurescited by 57
  23. 2018In Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinkingcited by 54
  24. 2023MmAP : Multi-modal Alignment Prompt for Cross-domain Multi-task Learningcited by 41
  25. 2023Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representationscited by 37
  26. 2021Video Transformer for Deepfake Detection with Incremental Learningcited by 33
  27. 2023Quality-Agnostic Deepfake Detection with Intra-model Collaborative Learningcited by 32
  28. 2020DeepFakesON-Phys: DeepFakes Detection based on Heart Rate Estimationcited by 29
  29. 2021Looking into Your Speech: Learning Cross-modal Affinity for Audio-visual Speech Separationcited by 27
  30. 2023DeepFake-Adapter: Dual-Level Adapter for DeepFake Detectioncited by 26
  31. 2023DFIL: Deepfake Incremental Learning by Exploiting Domain-invariant Forgery Cluescited by 23
  32. 2023LAMM: Label Alignment for Multi-Modal Prompt Learningcited by 15
  33. 2023Real Face Foundation Representation Learning for Generalized Deepfake Detectioncited by 8
  34. 2023AVTENet: A Human-Cognition-Inspired Audio-Visual Transformer-Based Ensemble Network for Video Deepfake Detectioncited by 8
  35. 2023A Unified Framework for Modality-Agnostic Deepfakes Detectioncited by 2
  36. 2024DPL: Cross-quality DeepFake Detection via Dual Progressive Learningcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Contrasting Deepfakes Diffusion via Contrastive Learning and Global-Local Similarities
  2. 2024Evolving from Single-modal to Multi-modal Facial Deepfake Detection: Progress and Challenges
  3. 2026Revealing the Truth with ConLLM for Detecting Multi-Modal Deepfakes
  4. 2025Training-Free Multimodal Deepfake Detection via Graph Reasoning
  5. 2025DFBench: Benchmarking Deepfake Image Detection Capability of Large Multimodal Models
  6. 2023Parents and Children: Distinguishing Multimodal DeepFakes from Natural Images
  7. 2026Leveraging large multimodal models for audio-video deepfake detection: a pilot study
  8. 2026VendorBench-100: A Unified Cross-Paradigm Benchmark for Deepfake Image Detection