Image Manipulation Detection by Multi-View Multi-Scale Supervision
Not on the map. Why?
Abstract (arXiv)
The key challenge of image manipulation detection is how to learn generalizable features that are sensitive to manipulations in novel data, whilst specific to prevent false alarms on authentic images. Current research emphasizes the sensitivity, with the specificity overlooked. In this paper we address both aspects by multi-view feature learning and multi-scale supervision. By exploiting noise distribution and boundary artifact surrounding tampered regions, the former aims to learn semantic-agnostic and thus more generalizable features. The latter allows us to learn from authentic images which are nontrivial to be taken into account by current semantic segmentation network based methods. Our thoughts are realized by a new network which we term MVSS-Net. Extensive experiments on five benchmark sets justify the viability of MVSS-Net for both pixel-level and image-level manipulation detection.
Key facts. Cited by 111 papers in the map (data through 14 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 14 Apr 2021.
Builds on
18 of 32 references.
References · 18
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2018Dual Attention Network for Scene Segmentationcited by 1,003
- 2020Media Forensics and DeepFakes: an overviewcited by 209
- 2018Learning Rich Features for Image Manipulation Detectioncited by 154
- 2018Learning a Discriminative Feature Network for Semantic Segmentationcited by 114
6 more
- 2020SPAN: Spatial Pyramid Attention Network forImage Manipulation Localizationcited by 92
- 2017Image Splicing Localization Using A Multi-Task Fully Convolutional Network (MFCN)cited by 64
- 2018Generate, Segment and Refine: Towards Generic Manipulation Segmentationcited by 33
- 2019Learn to Segment Retinal Lesions and Beyondcited by 33
- 2019Constrained R-CNN: A general image manipulation detection modelcited by 29
- 2020Wish You Were Here: Context-Aware Human Generationcited by 10
Built on by
Citing papers per year: 2021: 3; 2022: 14; 2023: 26; 2024: 19; 2025: 25; 2026: 24.
111 papers.
Sort:
By area:
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 111
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
- 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 44
- 2022Multimodal Fake News Detection via CLIP-Guided Learningcited by 42
- 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
- 2024Mesoscopic Insights: Orchestrating Multi-scale & Hybrid Architecture for Image Manipulation Localizationcited by 35
- 2024V2A-Mark: Versatile Deep Visual-Audio Watermarking for Manipulation Localization and Copyright Protectioncited by 28
38 more
- 2022Bootstrapping Multi-view Representations for Fake News Detectioncited by 25
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learningcited by 23
- 2023Pre-training-free Image Manipulation Localization through Non-Mutually Exclusive Contrastive Learningcited by 23
- 2025ForensicHub: A Unified Benchmark & Codebase for All-Domain Fake Image Detection and Localizationcited by 22
- 2023Rethinking Image Editing Detection in the Era of Generative AI Revolutioncited by 21
- 2023Toward Real Text Manipulation Detection: New Dataset and New Solutioncited by 20
- 2022Learning to Immunize Images for Tamper Localization and Self-Recoverycited by 19
- 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localizationcited by 16
- 2023Effective Image Tampering Localization via Enhanced Transformer and Co-attention Fusioncited by 15
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localizationcited by 13
- 2021GCA-Net : Utilizing Gated Context Attention for Improving Image Forgery Localization and Detectioncited by 11
- 2023Multi-spectral Class Center Network for Face Manipulation Detection and Localizationcited by 11
- 2023M3Dsynth: A dataset of medical 3D images with AI-generated local manipulationscited by 11
- 2024Learning to Discover Forgery Cues for Face Forgery Detectioncited by 11
- 2024ForgerySleuth: Empowering Multimodal Large Language Models for Image Manipulation Detectioncited by 11
- 2023DRAW: Defending Camera-shooted RAW against Image Manipulationcited by 10
- 2021RWN: Robust Watermarking Network for Image Cropping Localizationcited by 9
- 2022VideoFACT: Detecting Video Forgeries Using Attention, Scene Context, and Forensic Tracescited by 9
- 2023Rethinking Boundary Detection in Deep Learning Models for Medical Image Segmentationcited by 9
- 2024Harmfully Manipulated Images Matter in Multimodal Misinformation Detectioncited by 9
- 2022Towards Effective Image Manipulation Detection with Proposal Contrastive Learningcited by 8
- 2023TBFormer: Two-Branch Transformer for Image Forgery Localizationcited by 8
- 2023A New Benchmark and Model for Challenging Image Manipulation Detectioncited by 8
- 2024ForgeryTTT: Zero-Shot Image Manipulation Localization with Test-Time Trainingcited by 8
- 2022An Overview of Recent Work in Media Forensics: Methods and Threatscited by 7
- 2023Discrepancy-Guided Reconstruction Learning for Image Forgery Detectioncited by 7
- 2024Mixture-of-Noises Enhanced Forgery-Aware Predictor for Multi-Face Manipulation Detection and Localizationcited by 7
- 2025Deep Learning in Concealed Dense Predictioncited by 6
- 2025M2SFormer: Multi-Spectral and Multi-Scale Attention with Edge-Aware Difficulty Guidance for Image Forgery Localizationcited by 6
- 2022ReLoc: A Restoration-Assisted Framework for Robust Image Tampering Localizationcited by 5
- 2023Similarity-Aware Multimodal Prompt Learning for Fake News Detectioncited by 5
- 2023RetouchingFFHQ: A Large-scale Dataset for Fine-grained Face Retouching Detectioncited by 5
- 2023COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detectioncited by 5
- 2023TrainFors: A Large Benchmark Training Dataset for Image Manipulation Detection and Localizationcited by 5
- 2023MMFusion: Combining Image Forensic Filters for Visual Manipulation Detection and Localizationcited by 5
- 2024Detecting AI-Generated Images via CLIPcited by 5
- 2022Effective Image Tampering Localization with Multi-Scale ConvNeXt Feature Fusioncited by 4
- 2025AnimeDL-2M: Million-Scale AI-Generated Anime Image Detection and Localization in Diffusion Eracited by 4
50 most cited of 111 All 111 (JSON)
- 2026GIFTBench: Diagnosing Generalization in Image Forgery Localization and Informing Model Design1 Oct 2026
- 2026Less Supervision, Better Generalization: Weakly Supervised Fake Region Localization in Diffusion-Edited Images29 Sep 2026
- 2026MM-VeriAgent: Learning to Use Extensive Tools to Verify Multimodal Misinformation with Reinforcement Learning25 Sep 2026
- 2026Evidence-Guided Detection, Localization and Explanation for Text-Centric Image Forensics2 Sep 2026
- 2026PATE-Forensics: Perception-as-Tool for Explainable Deepfake Forensics with General-Purpose MLLMs19 Aug 2026
- 2026HexMIL: Hierarchical Attention MIL for Ante-Hoc Explainable Detection of AI-Manipulated CT Volumes5 Aug 2026
- 2026Open-Set Visual Text Forensics via Sparse-Constraint Rectified Flow3 Aug 2026
- 2026Progressive Decision-Making for Localizing Open-Ended AI-Generated Image Forgeries31 Jul 2026
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors28 Jul 2026
- 2026ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization23 Jun 2026
- 2026Efficient Document Tampering Localization with Multi-Level Discrepancy Features and Unified DCT-Quantization Embedding21 Jun 2026
- 2026SARIF: Segment Anything for Robust Image Forensics19 Jun 2026
38 more
- 2026SynCred-Bench: Benchmarking Synthetic Credibility in AI-Generated Visual Misinformation2 Jun 2026
- 2026Towards Generalized Image Manipulation Localization via Score-based Model16 May 2026
- 2026Field-Localized Forgery Detection for Digital Identity Documents9 May 2026
- 2026TAP into the Patch Tokens: Leveraging Vision Foundation Model Features for AI-Generated Image Detection29 Apr 2026
- 2026Off-the-shelf Vision Models Benefit Image Manipulation Localization10 Apr 2026
- 2026SurFITR: A Dataset for Surveillance Image Forgery Detection and Localisation8 Apr 2026
- 2026Harmful Visual Content Manipulation Matters in Misinformation Detection Under Multimedia Scenarios22 Mar 2026
- 2026DOCFORGE-BENCH: A Comprehensive 0-shot Benchmark for Document Forgery Detection and Analysis2 Mar 2026
- 2026Can Image Splicing and Copy-Move Forgery Be Detected by the Same Model? Forensim: An Attention-Based State-Space Approach10 Feb 2026
- 2026Can We Build a Monolithic Model for Fake Image Detection? SICA: Semantic-Induced Constrained Adaptation for Unified-Yet-Discriminative Artifact Feature Space Reconstruction6 Feb 2026
- 2026ForensicFormer: Hierarchical Multi-Scale Reasoning for Cross-Domain Image Forgery Detection12 Jan 2026
- 2026SAPL: Semantic-Agnostic Prompt Learning in CLIP for Weakly Supervised Image Manipulation Localization9 Jan 2026
- 2025Code-in-the-Loop Forensics: Agentic Tool Use for Image Forgery Detection18 Dec 2025
- 2025DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline28 Nov 2025
- 2025Creating Blank Canvas Against AI-enabled Image Forgery27 Nov 2025
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learning22 Nov 2025
- 2025Toward Real-world Text Image Forgery Localization: Structured and Interpretable Data Synthesis16 Nov 2025
- 2025Revisiting Image Manipulation Localization under Realistic Manipulation Scenarios24 Sep 2025
- 2025Morphology-optimized Multi-Scale Fusion: Combining Local Artifacts and Mesoscopic Semantics for Deepfake Detection and Localization17 Sep 2025
- 2025Detecting Text Manipulation in Images using Vision Language Models12 Sep 2025
- 2025Webly-Supervised Image Manipulation Localization via Category-Aware Auto-Annotation28 Aug 2025
- 2025SDiFL: Stable Diffusion-Driven Framework for Image Forgery Localization27 Aug 2025
- 2025Leveraging Failed Samples: A Few-Shot and Training-Free Framework for Generalized Deepfake Detection13 Aug 2025
- 2025RelayFormer: A Unified Local-Global Attention Framework for Scalable Image and Video Manipulation Localization13 Aug 2025
- 2025CLUE: Leveraging Low-Rank Adaptation to Capture Latent Uncovered Evidence for Image Forgery Localization10 Aug 2025
- 2025Bridging Semantic Logic Gaps: A Cognition Inspired Multimodal Boundary Preserving Network for Image Manipulation Localization10 Aug 2025
- 2025UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization8 Aug 2025
- 2025Weakly-Supervised Image Forgery Localization via Vision-Language Collaborative Reasoning Framework2 Aug 2025
- 2025Beyond Fully Supervised Pixel Annotations: Scribble-Driven Weakly-Supervised Framework for Image Manipulation Localization17 Jul 2025
- 2025M2SFormer: Multi-Spectral and Multi-Scale Attention with Edge-Aware Difficulty Guidance for Image Forgery Localization26 Jun 2025
- 2025ForensicHub: A Unified Benchmark & Codebase for All-Domain Fake Image Detection and Localization16 May 2025
- 2025Rethinking Boundary Detection in Deep Learning-Based Medical Image Segmentation6 May 2025
- 2025AnimeDL-2M: Million-Scale AI-Generated Anime Image Detection and Localization in Diffusion Era15 Apr 2025
- 2025Deep Learning in Concealed Dense Prediction15 Apr 2025
- 2025MVFNet: Multipurpose Video Forensics Network using Multiple Forms of Forensic Evidence26 Mar 2025
- 2025Context-Aware Weakly Supervised Image Manipulation Localization with SAM Refinement26 Mar 2025
- 2025HRR: Hierarchical Retrospection Refinement for Generated Image Detection25 Feb 2025
- 2024Mesoscopic Insights: Orchestrating Multi-scale & Hybrid Architecture for Image Manipulation Localization18 Dec 2024
50 newest of 111 All 111 (JSON)
- 2025AnimeDL-2M: Million-Scale AI-Generated Anime Image Detection and Localization in Diffusion Eracited by 4
- 2025DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baselinecited by 3
- 2025CLUE: Leveraging Low-Rank Adaptation to Capture Latent Uncovered Evidence for Image Forgery Localizationcited by 1
- 2025UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localizationcited by 0
- 2025SDiFL: Stable Diffusion-Driven Framework for Image Forgery Localizationcited by 0
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learningcited by 0
- 2026Towards Generalized Image Manipulation Localization via Score-based Modelcited by 0
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectorscited by 0
- 2026Open-Set Visual Text Forensics via Sparse-Constraint Rectified Flowcited by 0
- 2026Open-Set Visual Text Forensics via Sparse-Constraint Rectified Flow3 Aug 2026
- 2026TIGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors28 Jul 2026
- 2026Towards Generalized Image Manipulation Localization via Score-based Model16 May 2026
- 2025DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline28 Nov 2025
- 2025Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learning22 Nov 2025
- 2025SDiFL: Stable Diffusion-Driven Framework for Image Forgery Localization27 Aug 2025
- 2025CLUE: Leveraging Low-Rank Adaptation to Capture Latent Uncovered Evidence for Image Forgery Localization10 Aug 2025
- 2025UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization8 Aug 2025
- 2025AnimeDL-2M: Million-Scale AI-Generated Anime Image Detection and Localization in Diffusion Era15 Apr 2025
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2024ForgerySleuth: Empowering Multimodal Large Language Models for Image Manipulation Detectioncited by 11
- 2025Code-in-the-Loop Forensics: Agentic Tool Use for Image Forgery Detectioncited by 4
- 2025Detecting Text Manipulation in Images using Vision Language Modelscited by 1
- 2024CoVLM: Leveraging Consensus from Vision-Language Models for Semi-supervised Multi-modal Fake News Detectioncited by 0
- 2026ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localizationcited by 0
- 2026ForensicsTok: Forensics-Guided Tokenized Modeling for Image Tampering Localization23 Jun 2026
- 2025Code-in-the-Loop Forensics: Agentic Tool Use for Image Forgery Detection18 Dec 2025
- 2025Detecting Text Manipulation in Images using Vision Language Models12 Sep 2025
- 2024ForgerySleuth: Empowering Multimodal Large Language Models for Image Manipulation Detection29 Nov 2024
- 2024CoVLM: Leveraging Consensus from Vision-Language Models for Semi-supervised Multi-modal Fake News Detection6 Oct 2024
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models3 Oct 2024
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 111
- 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 67
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
- 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 44
- 2022Multimodal Fake News Detection via CLIP-Guided Learningcited by 42
- 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
- 2024Mesoscopic Insights: Orchestrating Multi-scale & Hybrid Architecture for Image Manipulation Localizationcited by 35
- 2024V2A-Mark: Versatile Deep Visual-Audio Watermarking for Manipulation Localization and Copyright Protectioncited by 28
- 2022Bootstrapping Multi-view Representations for Fake News Detectioncited by 25
12 most cited of 93 All 93 (JSON)
- 2026GIFTBench: Diagnosing Generalization in Image Forgery Localization and Informing Model Design1 Oct 2026
- 2026Less Supervision, Better Generalization: Weakly Supervised Fake Region Localization in Diffusion-Edited Images29 Sep 2026
- 2026Evidence-Guided Detection, Localization and Explanation for Text-Centric Image Forensics2 Sep 2026
- 2026PATE-Forensics: Perception-as-Tool for Explainable Deepfake Forensics with General-Purpose MLLMs19 Aug 2026
- 2026HexMIL: Hierarchical Attention MIL for Ante-Hoc Explainable Detection of AI-Manipulated CT Volumes5 Aug 2026
- 2026Efficient Document Tampering Localization with Multi-Level Discrepancy Features and Unified DCT-Quantization Embedding21 Jun 2026
- 2026SARIF: Segment Anything for Robust Image Forensics19 Jun 2026
- 2026SynCred-Bench: Benchmarking Synthetic Credibility in AI-Generated Visual Misinformation2 Jun 2026
- 2026Field-Localized Forgery Detection for Digital Identity Documents9 May 2026
- 2026TAP into the Patch Tokens: Leveraging Vision Foundation Model Features for AI-Generated Image Detection29 Apr 2026
- 2026Off-the-shelf Vision Models Benefit Image Manipulation Localization10 Apr 2026
- 2026SurFITR: A Dataset for Surveillance Image Forgery Detection and Localisation8 Apr 2026
12 newest of 93 All 93 (JSON)