Learning Rich Features for Image Manipulation Detection
Not on the map. Why?
Abstract (arXiv)
Image manipulation detection is different from traditional semantic object detection because it pays more attention to tampering artifacts than to image content, which suggests that richer features need to be learned. We propose a two-stream Faster R-CNN network and train it endto- end to detect the tampered regions given a manipulated image. One of the two streams is an RGB stream whose purpose is to extract features from the RGB image input to find tampering artifacts like strong contrast difference, unnatural tampered boundaries, and so on. The other is a noise stream that leverages the noise features extracted from a steganalysis rich model filter layer to discover the noise inconsistency between authentic and tampered regions. We then fuse features from the two streams through a bilinear pooling layer to further incorporate spatial co-occurrence of these two modalities. Experiments on four standard image manipulation datasets demonstrate that our two-stream framework outperforms each individual stream, and also achieves state-of-the-art performance compared to alternative methods with robustness to resizing and compression.
Key facts. Cited by 154 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 38; 2022: 22; 2023: 35; 2024: 24; 2025: 19; 2026: 16.
154 papers.
Sort:
By area:
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 176
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2023Explicit Visual Prompting for Low-Level Structure Segmentationscited by 114
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
38 more
- 2021Learning JPEG Compression Artifacts for Image Manipulation Detection and Localizationcited by 78
- 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
- 2021Making Images Real Again: A Comprehensive Survey on Deep Image Compositioncited by 63
- 2023Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for nowcited by 61
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2023Online Detection of AI-Generated Imagescited by 55
- 2023Multimodal Automated Fact-Checking: A Surveycited by 53
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
- 2021FReTAL: Generalizing Deepfake Detection using Knowledge Distillation and Representation Learningcited by 44
- 2023Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionalitycited by 44
- 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 44
- 2024IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localizationcited by 42
- 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltalescited by 39
- 2021CoReD: Generalizing Fake Media Detection with Continual Representation using Distillationcited by 37
- 2022Learning Second Order Local Anomaly for General Face Forgery Detectioncited by 36
- 2021One Detector to Rule Them All: Towards a General Deepfake Attack Detection Frameworkcited by 33
- 2023Pixel-Inconsistency Modeling for Image Manipulation Localizationcited by 33
- 2021Evaluation of an Audio-Video Multimodal Deepfake Dataset using Unimodal and Multimodal Detectorscited by 32
- 2023Contrastive Pseudo Learning for Open-World DeepFake Attributioncited by 27
- 2021TransForensics: Image Forgery Localization with Dense Self-Attentioncited by 26
- 2021Spatial-Separated Curve Rendering Network for Efficient and High-Resolution Image Harmonizationcited by 25
- 2022Bootstrapping Multi-view Representations for Fake News Detectioncited by 25
- 2021Self-Adversarial Training incorporating Forgery Attention for Image Forgery Localizationcited by 24
- 2023Weakly-supervised deepfake localization in diffusion-generated imagescited by 24
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learningcited by 23
- 2023Pre-training-free Image Manipulation Localization through Non-Mutually Exclusive Contrastive Learningcited by 23
- 2023Toward Real Text Manipulation Detection: New Dataset and New Solutioncited by 20
- 2021TAR: Generalized Forensic Framework to Detect Deepfakes using Weakly Supervised Learningcited by 19
- 2022Learning to Immunize Images for Tamper Localization and Self-Recoverycited by 19
- 2024GIM: A Million-scale Benchmark for Generative Image Manipulation Detection and Localizationcited by 19
- 2022Exposing Deepfake Face Forgeries with Guided Residualscited by 17
- 2023EXIF as Language: Learning Cross-Modal Associations Between Images and Camera Metadatacited by 17
- 2023Explicit Visual Prompting for Universal Foreground Segmentationscited by 17
- 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localizationcited by 16
- 2021Detection and Localization of Facial Expression Manipulationscited by 15
- 2023The Age of Synthetic Realities: Challenges and Opportunitiescited by 15
- 2024Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localizationcited by 15
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localizationcited by 13
50 most cited of 154 All 154 (JSON)
- 2026From Sharp Eyes to Expert Mind: Internalizing Expert Knowledge in MLLMs for Tampered Text Detection28 Sep 2026
- 2026VizAnchor: Decoding Manipulation Intent from Tampering Visualizations via Dual-Anchor Reasoning25 Aug 2026
- 2026Open-Set Visual Text Forensics via Sparse-Constraint Rectified Flow3 Aug 2026
- 2026Format-Controlled Multi-Scale JPEG Compression Response Analysis for Image-Level Forgery Screening7 Jul 2026
- 2026AI-Generated Image Recognition via Fusion of CNNs and Vision Transformers26 Jun 2026
- 2026SARIF: Segment Anything for Robust Image Forensics19 Jun 2026
- 2026On the Origin of Synthetic Information by Means of Steganographic Inheritance26 May 2026
- 2026Towards Generalized Image Manipulation Localization via Score-based Model16 May 2026
- 2026Digital Image Forgery Detection Using Transfer Learning4 May 2026
- 2026SLICE: Semantic Latent Injection via Compartmentalized Embedding for Image Watermarking13 Mar 2026
- 2026RecoverMark: Robust Watermarking for Localization and Recovery of Manipulated Faces24 Feb 2026
- 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization15 Feb 2026
38 more
- 2026Can We Build a Monolithic Model for Fake Image Detection? SICA: Semantic-Induced Constrained Adaptation for Unified-Yet-Discriminative Artifact Feature Space Reconstruction6 Feb 2026
- 2026Aggregating Diverse Cue Experts for AI-Generated Image Detection13 Jan 2026
- 2026ForensicFormer: Hierarchical Multi-Scale Reasoning for Cross-Domain Image Forgery Detection12 Jan 2026
- 2026Shallow- and Deep-fake Image Manipulation Localization Using Vision Mamba and Guided Graph Neural Network5 Jan 2026
- 2025NeXT-IMDL: Build Benchmark for NeXT-Generation Image Manipulation Detection & Localization29 Dec 2025
- 2025VAAS: Vision-Attention Anomaly Scoring for Image Manipulation Detection in Digital Forensics17 Dec 2025
- 2025Detection of Digital Facial Retouching utilizing Face Beauty Information9 Dec 2025
- 2025REVEAL: Reasoning-Enhanced Forensic Evidence Analysis for Explainable AI-Generated Image Detection28 Nov 2025
- 2025SONAR: Spectral-Contrastive Audio Residuals for Generalizable Deepfake Detection26 Nov 2025
- 2025FoCLIP: A Feature-Space Misalignment Framework for CLIP-Based Image Manipulation and Detection10 Nov 2025
- 2025Detecting AI-Generated Images via Contextual Anomaly Estimation in Masked AutoEncoders9 Nov 2025
- 2025CBDiff:Conditional Bernoulli Diffusion Models for Image Forgery Localization22 Oct 2025
- 2025Tell-Tale Watermarks for Explanatory Reasoning in Synthetic Media Forensics6 Sep 2025
- 2025Webly-Supervised Image Manipulation Localization via Category-Aware Auto-Annotation28 Aug 2025
- 2025SDiFL: Stable Diffusion-Driven Framework for Image Forgery Localization27 Aug 2025
- 2025Propose and Rectify: A Forensics-Driven MLLM Framework for Image Manipulation Localization25 Aug 2025
- 2025UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization8 Aug 2025
- 2025Unraveling Hidden Representations: A Multi-Modal Layer Analysis for Better Synthetic Content Forensics1 Aug 2025
- 2025On the Reliability of Vision-Language Models Under Adversarial Frequency-Domain Perturbations30 Jul 2025
- 2025LayLens: Improving Deepfake Understanding through Simplified Explanations14 Jul 2025
- 2025M2SFormer: Multi-Spectral and Multi-Scale Attention with Edge-Aware Difficulty Guidance for Image Forgery Localization26 Jun 2025
- 2025TRAP: Targeted Redirecting of Agentic Preferences29 May 2025
- 2025Prefill-Guided Thinking for zero-shot detection of AI-generated images20 May 2025
- 2024Image Forgery Localization via Guided Noise and Multi-Scale Feature Aggregation17 Nov 2024
- 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localization31 Oct 2024
- 2024HRGR: Enhancing Image Manipulation Detection via Hierarchical Region-aware Graph Reasoning29 Oct 2024
- 2024Towards Real Zero-Shot Camouflaged Object Segmentation without Camouflaged Annotations22 Oct 2024
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization14 Oct 2024
- 2024Perturb, Attend, Detect and Localize (PADL): Robust Proactive Image Defense26 Sep 2024
- 2024TMFNet: Two-Stream Multi-Channels Fusion Networks for Color Image Operation Chain Detection12 Sep 2024
- 2024A Noise and Edge extraction-based dual-branch method for Shallowfake and Deepfake Localization2 Sep 2024
- 2024FastForensics: Efficient Two-Stream Design for Real-Time Image Manipulation Detection29 Aug 2024
- 2024Generating Automatically Print/Scan Textures for Morphing Attack Detection Applications18 Aug 2024
- 2024PIXELMOD: Improving Soft Moderation of Visual Misleading Information on Twitter30 Jul 2024
- 2024SWIFT: Semantic Watermarking for Image Forgery Thwarting26 Jul 2024
- 2024A Sanity Check for AI-generated Image Detection27 Jun 2024
- 2024GIM: A Million-scale Benchmark for Generative Image Manipulation Detection and Localization24 Jun 2024
- 2024Trusted Video Inpainting Localization via Deep Attentive Noise Learning19 Jun 2024
50 newest of 154 All 154 (JSON)
- 2023DIRE for Diffusion-Generated Image Detectioncited by 390
- 2023Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionalitycited by 44
- 2023Weakly-supervised deepfake localization in diffusion-generated imagescited by 24
- 2026SLICE: Semantic Latent Injection via Compartmentalized Embedding for Image Watermarkingcited by 7
- 2024FRRffusion: Unveiling Authenticity with Diffusion-Based Face Retouching Reversalcited by 0
- 2025UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localizationcited by 0
- 2025SDiFL: Stable Diffusion-Driven Framework for Image Forgery Localizationcited by 0
- 2025CBDiff:Conditional Bernoulli Diffusion Models for Image Forgery Localizationcited by 0
- 2026Towards Generalized Image Manipulation Localization via Score-based Modelcited by 0
- 2026Open-Set Visual Text Forensics via Sparse-Constraint Rectified Flowcited by 0
- 2026Open-Set Visual Text Forensics via Sparse-Constraint Rectified Flow3 Aug 2026
- 2026Towards Generalized Image Manipulation Localization via Score-based Model16 May 2026
- 2026SLICE: Semantic Latent Injection via Compartmentalized Embedding for Image Watermarking13 Mar 2026
- 2025CBDiff:Conditional Bernoulli Diffusion Models for Image Forgery Localization22 Oct 2025
- 2025SDiFL: Stable Diffusion-Driven Framework for Image Forgery Localization27 Aug 2025
- 2025UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization8 Aug 2025
- 2024FRRffusion: Unveiling Authenticity with Diffusion-Based Face Retouching Reversal13 May 2024
- 2023Weakly-supervised deepfake localization in diffusion-generated images8 Nov 2023
- 2023Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionality5 Jul 2023
- 2023DIRE for Diffusion-Generated Image Detection16 Mar 2023
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localizationcited by 13
- 2025TRAP: Targeted Redirecting of Agentic Preferencescited by 5
- 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localizationcited by 2
- 2025Prefill-Guided Thinking for zero-shot detection of AI-generated imagescited by 0
- 2026ForgeryVCR: Visual-Centric Reasoning via Efficient Forensic Tools in MLLMs for Image Forgery Detection and Localization15 Feb 2026
- 2025TRAP: Targeted Redirecting of Agentic Preferences29 May 2025
- 2025Prefill-Guided Thinking for zero-shot detection of AI-generated images20 May 2025
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization14 Oct 2024
- 2021Generalizing Face Forgery Detection with High-frequency Featurescited by 262
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 176
- 2021Exploring Temporal Coherence for More General Video Face Forgery Detectioncited by 159
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2023Explicit Visual Prompting for Low-Level Structure Segmentationscited by 114
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2022Protecting Celebrities from DeepFake with Identity Consistency Transformercited by 95
- 2021Learning JPEG Compression Artifacts for Image Manipulation Detection and Localizationcited by 78
12 most cited of 136 All 136 (JSON)
- 2026From Sharp Eyes to Expert Mind: Internalizing Expert Knowledge in MLLMs for Tampered Text Detection28 Sep 2026
- 2026VizAnchor: Decoding Manipulation Intent from Tampering Visualizations via Dual-Anchor Reasoning25 Aug 2026
- 2026Format-Controlled Multi-Scale JPEG Compression Response Analysis for Image-Level Forgery Screening7 Jul 2026
- 2026AI-Generated Image Recognition via Fusion of CNNs and Vision Transformers26 Jun 2026
- 2026SARIF: Segment Anything for Robust Image Forensics19 Jun 2026
- 2026On the Origin of Synthetic Information by Means of Steganographic Inheritance26 May 2026
- 2026Digital Image Forgery Detection Using Transfer Learning4 May 2026
- 2026RecoverMark: Robust Watermarking for Localization and Recovery of Manipulated Faces24 Feb 2026
- 2026Can We Build a Monolithic Model for Fake Image Detection? SICA: Semantic-Induced Constrained Adaptation for Unified-Yet-Discriminative Artifact Feature Space Reconstruction6 Feb 2026
- 2026Aggregating Diverse Cue Experts for AI-Generated Image Detection13 Jan 2026
- 2026ForensicFormer: Hierarchical Multi-Scale Reasoning for Cross-Domain Image Forgery Detection12 Jan 2026
- 2025NeXT-IMDL: Build Benchmark for NeXT-Generation Image Manipulation Detection & Localization29 Dec 2025
12 newest of 136 All 136 (JSON)