DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Diffusion-based image editing has made semantic level image manipulation easy for general users, but it also enables realistic local forgeries that are hard to localize. Existing benchmarks mainly focus on the binary detection of generated images or the localization of manually edited regions and do not reflect the properties of diffusion-based edits, which often blend smoothly into the original content. We present Diffusion-Based Image Editing Area Localization Dataset (DEAL-300K), a large scale dataset for diffusion-based image manipulation localization (DIML) with more than 300,000 annotated images. We build DEAL-300K by using a multi-modal large language model to generate editing instructions, a mask-free diffusion editor to produce manipulated images, and an active-learning change detection pipeline to obtain pixel-level annotations. On top of this dataset, we propose a localization framework that uses a frozen Visual Foundation Model (VFM) together with Multi Frequency Prompt Tuning (MFPT) to capture both semantic and frequency-domain cues of edited regions. Trained on DEAL-300K, our method reaches a pixel-level F1 score of 82.56% on our test split and 80.97% on the external CoCoGlide benchmark, providing strong baselines and a practical foundation for future DIML research.The dataset can be accessed via https://github.com/ymhzyj/DEAL-300K.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 61 of its 75 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
61 of 75 references.
Closest ancestors · 12
Same direction, newest first
- 2023Weakly-supervised deepfake localization in diffusion-generated images8 Nov
- 2023Dynamic Prompt Learning: Addressing Cross-Attention Leakage for Text-Based Image Editing27 Sep
- 2023DIRE for Diffusion-Generated Image Detection16 Mar
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022GLFF: Global and Local Feature Fusion for AI-synthesized Image Detection16 Nov
- 2022On the detection of synthetic images generated by diffusion models1 Nov
- 2022DiffEdit: Diffusion-based semantic image editing with mask guidance20 Oct
- 2022Imagic: Text-Based Real Image Editing with Diffusion Models17 Oct
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
Other references · 49
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Visual Instruction Tuningcited by 7,869
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
37 more
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2022Visual Prompt Tuningcited by 1,681
- 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2019When Does Label Smoothing Help?cited by 988
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 691
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 624
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 381
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2023Recognize Anything: A Strong Image Tagging Modelcited by 309
- 2020Theoretical Analysis of Self-Training with Deep Networks on Unlabeled Datacited by 180
- 2023QA-LoRA: Quantization-Aware Low-Rank Adaptation of Large Language Modelscited by 155
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2024MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokenscited by 118
- 2018Noiseprint: a CNN-based camera model fingerprintcited by 114
- 2019Consistency-based Semi-supervised Active Learning: Towards Minimizing Labeling Costcited by 114
- 2023Explicit Visual Prompting for Low-Level Structure Segmentationscited by 114
- 2021Image Manipulation Detection by Multi-View Multi-Scale Supervisioncited by 111
- 2019ViewAL: Active Learning with Viewpoint Entropy for Semantic Segmentationcited by 96
- 2023Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic Segmentationcited by 83
- 2023AV-Deepfake1M: A Large-Scale LLM-Driven Audio-Visual Deepfake Datasetcited by 80
- 2021Learning JPEG Compression Artifacts for Image Manipulation Detection and Localizationcited by 78
- 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
- 2022Fast Vision Transformers with HiLo Attentioncited by 78
- 2023Adapting Segment Anything Model for Change Detection in HR Remote Sensing Imagescited by 56
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
- 2024Mora: Enabling Generalist Video Generation via A Multi-Agent Frameworkcited by 45
- 2016DisturbLabel: Regularizing CNN on the Loss Layercited by 41
- 2020DEAL: Difficulty-aware Active Learning for Semantic Segmentationcited by 32
- 2023Effective Image Tampering Localization via Enhanced Transformer and Co-attention Fusioncited by 15
- 2023Spectral Prompt Tuning:Unveiling Unseen Classes for Zero-Shot Semantic Segmentationcited by 11
- 2023A New Benchmark and Model for Challenging Image Manipulation Detectioncited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026DailyBench: A Unified Benchmark for AI-Generated and Manipulated Images from Modern Generative Modelscited by 2
- 2026SIGMA: Semantic-Difference Instruction-Grounding Mask Annotator for Text-Driven Image Manipulation Localizationcited by 0
- 2026Less Supervision, Better Generalization: Weakly Supervised Fake Region Localization in Diffusion-Edited Imagescited by 0
- 2026Less Supervision, Better Generalization: Weakly Supervised Fake Region Localization in Diffusion-Edited Images29 Sep 2026
- 2026DailyBench: A Unified Benchmark for AI-Generated and Manipulated Images from Modern Generative Models27 Jul 2026
- 2026SIGMA: Semantic-Difference Instruction-Grounding Mask Annotator for Text-Driven Image Manipulation Localization27 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025X-Edit: Detecting and Localizing Edits in Images Altered by Text-Guided Diffusion Models
- 2024EditScout: Locating Forged Regions from Diffusion-based Edited Images with Multimodal LLM
- 2025DiffSeg30k: A Multi-Turn Diffusion Editing Benchmark for Localized AIGC Detection
- 2025Can VLMs Detect and Localize Fine-Grained AI-Edited Images?
- 2025UGD-IML: A Unified Generative Diffusion-based Framework for Constrained and Unconstrained Image Manipulation Localization
- 2026Rethinking Where to Edit: Task-Aware Localization for Instruction-Based Image Editing
- 2025EditMGT: Unleashing Potentials of Masked Generative Transformers in Image Editing
- 2025PartEdit: Fine-Grained Image Editing using Pre-Trained Diffusion Models