AlignGemini: Generalizable AI-Generated Image Detection Through Task-Model Alignment
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
also in 1 more
Abstract (arXiv)
Vision Language Models (VLMs) are increasingly used for detecting AI-generated images (AIGI). However, converting VLMs into reliable detectors is resource-intensive, and the resulting models often suffer from hallucination and poor generalization. To investigate the root cause, we conduct an empirical analysis and identify two consistent behaviors. First, fine-tuning VLMs with semantic supervision improves semantic discrimination and generalizes well to unseen data. Second, fine-tuning VLMs with pixel-artifact supervision leads to weak generalization. These findings reveal a fundamental task-model misalignment. VLMs are optimized for high-level semantic reasoning and lack inductive bias toward low-level pixel artifacts. In contrast, conventional vision models effectively capture pixel-level artifacts but are less sensitive to semantic inconsistencies. This indicates that different models are naturally suited to different subtasks. Based on this insight, we formulate AIGI detection as two orthogonal subtasks: semantic consistency checking and pixel-artifact detection. Neglecting either subtask leads to systematic detection failures. We further propose the Task-Model Alignment principle and instantiate it in a two-branch detector, AlignGemini. The detector combines a VLM trained with pure semantic supervision and a vision model trained with pure pixel-artifact supervision. By enforcing clear specialization, each branch captures complementary cues. Experiments on in-the-wild benchmarks show that AlignGemini improves average accuracy by 9.5 percent using simplified training data. These results demonstrate that task-model alignment is an effective principle for generalizable AIGI detection.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 40 of its 51 references that are in the map. First posted on arXiv 7 Dec 2025.
Builds on
40 of 51 references.
Closest ancestors · 2
Same direction, newest first
- 2025VisuRiddles: Fine-grained Perception is a Primary Bottleneck for Multimodal Large Language Models in Abstract Visual Reasoning3 Jun
- 2025HueManity: Probing Fine-Grained Visual Perception in MLLMs31 May
Other references · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2016Pixel Recurrent Neural Networkscited by 816
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2024Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?cited by 232
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2023Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detectioncited by 182
- 2023PatchCraft: Exploring Texture Patch for Efficient AI-generated Image Detectioncited by 122
26 more
- 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
- 2024Improving Synthetic Image Detection Towards Generalization: An Image Transformation Perspectivecited by 89
- 2024Can ChatGPT Detect DeepFakes? A Study of Using Multimodal Large Language Models for Media Forensicscited by 69
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
- 2024A Bias-Free Training Paradigm for More General AI-generated Image Detectioncited by 67
- 2025LEGION: Learning to Ground and Explain for Synthetic Image Detectioncited by 65
- 2024Any-Resolution AI-Generated Image Detection by Spectral Learningcited by 57
- 2024Real-Time Deepfake Detection in the Real-Worldcited by 51
- 2025Is Artificial Intelligence Generated Image Detection a Solved Problem?cited by 51
- 2024FIRE: Robust Detection of Diffusion-Generated Images via Frequency-Guided Reconstruction Errorcited by 47
- 2025CO-SPY: Combining Semantic and Pixel Features to Detect Synthetic Images by AIcited by 42
- 2025On the generalization of language models from in-context learning and finetuning: a controlled studycited by 40
- 2024Aligned Datasets Improve Detection of Latent Diffusion-Generated Imagescited by 36
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detectioncited by 35
- 2025Ivy-Fake: A Unified Explainable Framework and Benchmark for Image and Video AIGC Detectioncited by 34
- 2024Standing on the Shoulders of Giants: Reprogramming Visual-Language Model for General Deepfake Detectioncited by 30
- 2025BusterX++: Towards Unified Cross-Modal AI-Generated Content Detection and Explanation with MLLMcited by 29
- 2025Toward Generalizable Forgery Detection and Reasoningcited by 20
- 2025Seeing Before Reasoning: A Unified Framework for Generalizable and Explainable Fake Image Detectioncited by 20
- 2025MLLM-Enhanced Face Forgery Detection: A Vision-Language Fusion Solutioncited by 15
- 2025Towards Explainable Fake Image Detection with Multi-Modal Large Language Modelscited by 8
- 2025MIRAGE: Towards AI-Generated Image Detection in the Wildcited by 8
- 2025ThinkFake: Reasoning in Multimodal Large Language Models for AI-Generated Image Detectioncited by 7
- 2025ForenX: Towards Explainable AI-Generated Image Detection with Multimodal Large Language Modelscited by 6
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Modelscited by 3
- 2026Video as Natural Augmentation: Towards Unified AI-Generated Image and Video Detectioncited by 1
- 2026Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detectioncited by 0
- 2026Forensic Reserve: Eliciting Latent Knowledge for Image Forgery Detectioncited by 0
- 2026Forensic Reserve: Eliciting Latent Knowledge for Image Forgery Detection6 Oct 2026
- 2026Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detection17 Aug 2026
- 2026Deep Residual Injection for Full-Spectrum Forensic Signal Perception in Multimodal Large Language Models14 Jun 2026
- 2026Video as Natural Augmentation: Towards Unified AI-Generated Image and Video Detection21 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Re-Aligning Language to Visual Objects with an Agentic Workflow
- 2026Unleashing the Potential of Vision-Language Models for Generalizable AI-Generated Image Detection
- 2026UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Models
- 2025Interpretable and Reliable Detection of AI-Generated Images via Grounded Reasoning in MLLMs
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment
- 2025Prompt the Unseen: Evaluating Visual-Language Alignment Beyond Supervision
- 2026Detecting AI-Generated Video: A Vision-Language Dual-View Survey
- 2026Supervised Classification Heads as Semantic Prototypes: Unlocking Vision-Language Alignment via Weight Recycling