Towards Reliable Identification of Diffusion-based Image Manipulations
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Changing facial expressions, gestures, or background details may dramatically alter the meaning conveyed by an image. Notably, recent advances in diffusion models greatly improve the quality of image manipulation while also opening the door to misuse. Identifying changes made to authentic images, thus, becomes an important task, constantly challenged by new diffusion-based editing tools. To this end, we propose a novel approach for ReliAble iDentification of inpainted AReas (RADAR). RADAR builds on existing foundation models and combines features from different image modalities. It also incorporates an auxiliary contrastive loss that helps to isolate manipulated image patches. We demonstrate these techniques to significantly improve both the accuracy of our method and its generalisation to a large number of diffusion models. To support realistic evaluation, we further introduce BBC-PAIR, a new comprehensive benchmark, with images tampered by 28 diffusion models. Our experiments show that RADAR achieves excellent results, outperforming the state-of-the-art in detecting and localising image edits made by both seen and unseen diffusion models. Our code, data and models will be publicly available at https://alex-costanzino.github.io/radar/.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 61 of its 93 references that are in the map. First posted on arXiv 5 Jun 2025.
Builds on
61 of 93 references.
Closest ancestors · 13
Same direction, newest first
- 2024BrushEdit: All-In-One Image Inpainting and Editing13 Dec
- 2024Time Step Generating: A Universal Synthesized Deepfake Image Detector17 Nov
- 2024Kandinsky 3: Text-to-Image Synthesis for Multifunctional Generative Framework28 Oct
- 2024FakeInversion: Learning to Detect Images from Unseen Text-to-Image Models by Inverting Stable Diffusion12 Jun
- 2024Diffusion Model-Based Image Editing: A Survey27 Feb
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Error31 Jan
- 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusion5 Oct
- 2023DIRE for Diffusion-Generated Image Detection16 Mar
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpainting13 Dec
- 2022Blended Latent Diffusion6 Jun
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models20 Dec
1 more
Other references · 48
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2020Supervised Contrastive Learningcited by 2,829
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
- 2024Depth Anything V2cited by 1,422
36 more
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
- 2022Diffusion Models in Vision: A Surveycited by 1,015
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
- 2019Multimodal Transformer for Unaligned Multimodal Language Sequencescited by 645
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 620
- 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 514
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 141
- 2023Hierarchical Fine-Grained Image Forgery Detection and Localizationcited by 134
- 2022TruFor: Leveraging all-round clues for trustworthy image forgery detection and localizationcited by 130
- 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 113
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 108
- 2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
- 2020The Edge of Depth: Explicit Constraints between Segmentation and Depthcited by 72
- 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 68
- 2020Siamese Network for RGB-D Salient Object Detection and Beyondcited by 67
- 2023Shadows Don't Lie and Lines Can't Bend! Generative Models don't know Projective Geometry...for nowcited by 61
- 2023Online Detection of AI-Generated Imagescited by 55
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
- 2024FIRE: Robust Detection of Diffusion-Generated Images via Frequency-Guided Reconstruction Errorcited by 47
- 2023AutoSplice: A Text-prompt Manipulated Image Dataset for Media Forensicscited by 46
- 2024Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpaintingcited by 40
- 2024Mesoscopic Insights: Orchestrating Multi-scale & Hybrid Architecture for Image Manipulation Localizationcited by 35
- 2024WildFake: A Large-scale Challenging Dataset for AI-Generated Images Detectioncited by 31
- 2024Frequency Masking for Universal Deepfake Detectioncited by 23
- 2025OpenSDI: Spotting Diffusion-Generated Images in the Open Worldcited by 23
- 2024GIM: A Million-scale Benchmark for Generative Image Manipulation Detection and Localizationcited by 19
- 2024SAFIRE: Segment Any Forged Image Regioncited by 18
- 2024On Pretraining Data Diversity for Self-Supervised Learningcited by 7
- 2024Adaptive Deviation Learning for Visual Anomaly Detection with Data Contaminationcited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detectioncited by 6
- 2025Revisiting Image Manipulation Localization under Realistic Manipulation Scenarioscited by 3
- 2026Dissecting Agentic Forensics: The Role of Triage, Prompting, and Evidence Arbitration in Open-World Fake Image Detectioncited by 0
- 2026Less Supervision, Better Generalization: Weakly Supervised Fake Region Localization in Diffusion-Edited Imagescited by 0
- 2026Less Supervision, Better Generalization: Weakly Supervised Fake Region Localization in Diffusion-Edited Images29 Sep 2026
- 2026Dissecting Agentic Forensics: The Role of Triage, Prompting, and Evidence Arbitration in Open-World Fake Image Detection21 Sep 2026
- 2026EvoGuard: An Extensible Agentic RL-based Framework for Practical and Evolving AI-Generated Image Detection18 Mar 2026
- 2025Revisiting Image Manipulation Localization under Realistic Manipulation Scenarios24 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2023Differential Diffusion: Giving Each Pixel Its Strength
- 2025DEAL-300K: Diffusion-based Editing Area Localization with a 300K-Scale Dataset and Frequency-Prompted Baseline
- 2023Diffusion Brush: A Latent Diffusion Model-based Editing Tool for AI-generated Images
- 2025X-Edit: Detecting and Localizing Edits in Images Altered by Text-Guided Diffusion Models
- 2025End4: End-to-end Denoising Diffusion for Diffusion-Based Inpainting Detection
- 2023Diffusion Handles: Enabling 3D Edits for Diffusion Models by Lifting Activations to 3D
- 2023Towards Coherent Image Inpainting Using Denoising Diffusion Implicit Models
- 2025Edit2Perceive: Image Editing Diffusion Models Are Strong Dense Perceivers