UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Models
Not on the map. Why?
Abstract (arXiv)
Vision-Language Large Models (VLLMs) are promising for AI-generated image (AIGI) detection because they can produce both a prediction and a natural-language output. However, most existing VLLM-based detectors primarily fine-tune the language side while giving limited attention to low-level visual forensic cues. They also often depend on manually crafted prompts or human-annotated rationales, which limits scalability.We present UC-VLM, a unified multi-stage framework for AIGI detection that relies solely on binary supervision. UC-VLM first identifies effective instruction variants automatically. It then reuses the same binary label within a multi-stage training framework: (i) a visual discrimination objective that strengthens sensitivity to non-semantic forensic cues, and (ii) a label-conditioned generation objective that uses the binary label to supervise textual outputs. This design turns weak binary supervision into a shared supervision signal for both the visual pathway and the language output. Our key novelty is a unified multi-stage binary-supervised framework that consistently reuses the same authenticity labels for visual adaptation and label-conditioned text generation, while leveraging automatically optimized instructions to reduce prompt sensitivity without requiring human-written rationales or hand-crafted prompts.Experiments show that UC-VLM achieves 96.1% average accuracy on GenImage, exceeding the strongest prior result by 4.6%, and obtains 69.6% / 77.9% accuracy on Chameleon under ProGAN / SDV1.4 training, surpassing the best baseline by 11.2% / 15.3%, respectively.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 70 references that are in the map. First posted on arXiv 15 Aug 2026.
Builds on
56 of 70 references.
References · 56
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023Visual Instruction Tuningcited by 7,869
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
38 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2020Thinking in Frequency: Face Forgery Detection by Mining Frequency-aware Cluescited by 523
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2019Face X-ray for More General Face Forgery Detectioncited by 470
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2019Detecting and Simulating Artifacts in GAN Fake Imagescited by 293
- 2020Global Texture Enhancement for Fake Face Detection in the Wildcited by 220
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detectioncited by 88
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
- 2023Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for nowcited by 61
- 2024Zero-Shot Detection of AI-Generated Imagescited by 50
- 2023Generalizable Synthetic Image Detection via Language-guided Contrastive Learningcited by 49
- 2021OMPQ: Orthogonal Mixed Precision Quantizationcited by 39
- 2025AIGI-Holmes: Towards Explainable and Generalizable AI-Generated Image Detection via Multimodal Large Language Modelscited by 33
- 2026Flow caching for autoregressive video generationcited by 25
- 2025Mamba as a Bridge: Where Vision Foundation Models Meet Vision Language Models for Domain-Generalized Semantic Segmentationcited by 24
- 2025Vid-SME: Membership Inference Attacks against Large Video Understanding Modelscited by 19
- 2023Solving Oscillation Problem in Post-Training Quantization Through a Theoretical Perspectivecited by 17
- 2026Vision-Language-Action Safety: Threats, Challenges, Evaluations, and Mechanismscited by 13
- 2026Sponge Tool Attack: Stealthy Denial-of-Efficiency against Tool-Augmented Agentic Reasoningcited by 11
- 2023HEAP: Unsupervised Object Discovery and Localization with Contrastive Groupingcited by 10
- 2022Adaptive Domain Generalization via Online Disagreement Minimizationcited by 9
- 2026Tele-Omni: a Unified Multimodal Framework for Video Generation and Editingcited by 8
- 20253DOT: Texture Transfer for 3DGS Objects from a Single Reference Imagecited by 7
- 2026Bridging Day and Night: Target-Class Hallucination Suppression in Unpaired Image Translationcited by 6
- 2026White-Balance First, Adjust Later: Cross-Camera Color Constancy via Vision-Language Evaluationcited by 4
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Unleashing the Potential of Vision-Language Models for Generalizable AI-Generated Image Detection
- 2025Interpretable and Reliable Detection of AI-Generated Images via Grounded Reasoning in MLLMs
- 2025Towards Explainable Fake Image Detection with Multi-Modal Large Language Models
- 2025AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignment
- 2025Identity-Aware Vision-Language Model for Explainable Face Forgery Detection
- 2026Simplicity Prevails: The Emergence of Generalizable AIGI Detection in Visual Foundation Models
- 2026Rethinking VLMs for Image Forgery Detection and Localization
- 2025Locate-Then-Examine: Grounded Region Reasoning Improves Detection of AI-Generated Images