Generate, Segment and Refine: Towards Generic Manipulation Segmentation
Not on the map. Why?
Abstract (arXiv)
Detecting manipulated images has become a significant emerging challenge. The advent of image sharing platforms and the easy availability of advanced photo editing software have resulted in a large quantities of manipulated images being shared on the internet. While the intent behind such manipulations varies widely, concerns on the spread of fake news and misinformation is growing. Current state of the art methods for detecting these manipulated images suffers from the lack of training data due to the laborious labeling process. We address this problem in this paper, for which we introduce a manipulated image generation process that creates true positives using currently available datasets. Drawing from traditional work on image blending, we propose a novel generator for creating such examples. In addition, we also propose to further create examples that force the algorithm to focus on boundary artifacts during training. Strong experimental results validate our proposal.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 24 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 8; 2024: 10; 2025: 1; 2026: 2.
33 papers.
Sort:
By area:
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 42
- 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltalescited by 39
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learningcited by 23
- 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localizationcited by 16
- 2024Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localizationcited by 15
- 2021Deep Video Inpainting Detectioncited by 11
- 2021GCA-Net : Utilizing Gated Context Attention for Improving Image Forgery Localization and Detectioncited by 11
- 2023Multi-spectral Class Center Network for Face Manipulation Detection and Localizationcited by 11
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localizationcited by 11
21 more
- 2022Towards Effective Image Manipulation Detection with Proposal Contrastive Learningcited by 8
- 2023TBFormer: Two-Branch Transformer for Image Forgery Localizationcited by 8
- 2024FrozenSeg: Harmonizing Frozen Foundation Models for Open-Vocabulary Segmentationcited by 6
- 2023TrainFors: A Large Benchmark Training Dataset for Image Manipulation Detection and Localizationcited by 5
- 2022Noise and Edge Based Dual Branch Image Manipulation Detectioncited by 3
- 2024Dense Feature Interaction Network for Image Inpainting Localizationcited by 3
- 2022Inharmonious Region Localization by Magnifying Domain Discrepancycited by 2
- 2025Context-Aware Weakly Supervised Image Manipulation Localization with SAM Refinementcited by 2
- 2022Learning Hierarchical Graph Representation for Image Manipulation Detectioncited by 1
- 2022MSMG-Net: Multi-scale Multi-grained Supervised Metworks for Multi-task Image Manipulation Detection and Localizationcited by 1
- 2023UVL2: A Unified Framework for Video Tampering Localizationcited by 1
- 2024Video Inpainting Localization with Contrastive Learningcited by 1
- 2024A Noise and Edge extraction-based dual-branch method for Shallowfake and Deepfake Localizationcited by 1
- 2022Inharmonious Region Localization via Recurrent Self-Reasoningcited by 0
- 2022Auto-Focus Contrastive Learning for Image Manipulation Detectioncited by 0
- 2023Perceptual MAE for Image Manipulation Localization: A High-level Vision Learner Focusing on Low-level Featurescited by 0
- 2024Mumpy: Multilateral Temporal-view Pyramid Transformer for Video Inpainting Detectioncited by 0
- 2024Trusted Video Inpainting Localization via Deep Attentive Noise Learningcited by 0
- 2024Detecting Inpainted Video with Frequency Domain Insightscited by 0
- 2026SAPL: Semantic-Agnostic Prompt Learning in CLIP for Weakly Supervised Image Manipulation Localizationcited by 0
- 2026Progressive Decision-Making for Localizing Open-Ended AI-Generated Image Forgeriescited by 0
- 2026Progressive Decision-Making for Localizing Open-Ended AI-Generated Image Forgeries31 Jul 2026
- 2026SAPL: Semantic-Agnostic Prompt Learning in CLIP for Weakly Supervised Image Manipulation Localization9 Jan 2026
- 2025Context-Aware Weakly Supervised Image Manipulation Localization with SAM Refinement26 Mar 2025
- 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localization31 Oct 2024
- 2024ForgeryGPT: A Multimodal LLM for Interpretable Image Forgery Detection and Localization14 Oct 2024
- 2024Detecting Inpainted Video with Frequency Domain Insights21 Sep 2024
- 2024FrozenSeg: Harmonizing Frozen Foundation Models for Open-Vocabulary Segmentation5 Sep 2024
- 2024A Noise and Edge extraction-based dual-branch method for Shallowfake and Deepfake Localization2 Sep 2024
- 2024Dense Feature Interaction Network for Image Inpainting Localization5 Aug 2024
- 2024Video Inpainting Localization with Contrastive Learning25 Jun 2024
- 2024Trusted Video Inpainting Localization via Deep Attentive Noise Learning19 Jun 2024
- 2024Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localization19 Jun 2024
21 more
- 2024Mumpy: Multilateral Temporal-view Pyramid Transformer for Video Inpainting Detection17 Apr 2024
- 2023Perceptual MAE for Image Manipulation Localization: A High-level Vision Learner Focusing on Low-level Features10 Oct 2023
- 2023UVL2: A Unified Framework for Video Tampering Localization28 Sep 2023
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learning3 Sep 2023
- 2023TrainFors: A Large Benchmark Training Dataset for Image Manipulation Detection and Localization10 Aug 2023
- 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformer27 Jul 2023
- 2023Multi-spectral Class Center Network for Face Manipulation Detection and Localization18 May 2023
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localization30 Mar 2023
- 2023TBFormer: Two-Branch Transformer for Image Forgery Localization25 Feb 2023
- 2022Auto-Focus Contrastive Learning for Image Manipulation Detection20 Nov 2022
- 2022MSMG-Net: Multi-scale Multi-grained Supervised Metworks for Multi-task Image Manipulation Detection and Localization6 Nov 2022
- 2022Towards Effective Image Manipulation Detection with Proposal Contrastive Learning16 Oct 2022
- 2022Inharmonious Region Localization via Recurrent Self-Reasoning5 Oct 2022
- 2022Inharmonious Region Localization by Magnifying Domain Discrepancy30 Sep 2022
- 2022Noise and Edge Based Dual Branch Image Manipulation Detection2 Jul 2022
- 2022Learning Hierarchical Graph Representation for Image Manipulation Detection15 Jan 2022
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detection16 Dec 2021
- 2021GCA-Net : Utilizing Gated Context Attention for Improving Image Forgery Localization and Detection8 Dec 2021
- 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltales13 Jul 2021
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervision14 Apr 2021
- 2021Deep Video Inpainting Detection26 Jan 2021
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021MVSS-Net: Multi-View Multi-Scale Supervised Networks for Image Manipulation Detectioncited by 117
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2023IML-ViT: Benchmarking Image Manipulation Localization by Vision Transformercited by 42
- 2021Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltalescited by 39
- 2023Towards Generic Image Manipulation Detection with Weakly-Supervised Self-Consistency Learningcited by 23
- 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localizationcited by 16
- 2024Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localizationcited by 15
- 2021Deep Video Inpainting Detectioncited by 11
- 2021GCA-Net : Utilizing Gated Context Attention for Improving Image Forgery Localization and Detectioncited by 11
- 2023Multi-spectral Class Center Network for Face Manipulation Detection and Localizationcited by 11
- 2022Towards Effective Image Manipulation Detection with Proposal Contrastive Learningcited by 8
12 most cited of 31 All 31 (JSON)
- 2026SAPL: Semantic-Agnostic Prompt Learning in CLIP for Weakly Supervised Image Manipulation Localization9 Jan 2026
- 2025Context-Aware Weakly Supervised Image Manipulation Localization with SAM Refinement26 Mar 2025
- 2024Language-guided Hierarchical Fine-grained Image Forgery Detection and Localization31 Oct 2024
- 2024Detecting Inpainted Video with Frequency Domain Insights21 Sep 2024
- 2024FrozenSeg: Harmonizing Frozen Foundation Models for Open-Vocabulary Segmentation5 Sep 2024
- 2024A Noise and Edge extraction-based dual-branch method for Shallowfake and Deepfake Localization2 Sep 2024
- 2024Dense Feature Interaction Network for Image Inpainting Localization5 Aug 2024
- 2024Video Inpainting Localization with Contrastive Learning25 Jun 2024
- 2024Trusted Video Inpainting Localization via Deep Attentive Noise Learning19 Jun 2024
- 2024Exploring Multi-view Pixel Contrast for General and Robust Image Forgery Localization19 Jun 2024
- 2024Mumpy: Multilateral Temporal-view Pyramid Transformer for Video Inpainting Detection17 Apr 2024
- 2023Perceptual MAE for Image Manipulation Localization: A High-level Vision Learner Focusing on Low-level Features10 Oct 2023
12 newest of 31 All 31 (JSON)