HFI: A unified framework for training-free detection and implicit watermarking of latent diffusion model generated images
On the map: Diffusion models → Robustness, privacy and adversarial aspects
also in 1 more
Abstract (arXiv)
Dramatic advances in the quality of the latent diffusion models (LDMs) also led to the malicious use of AI-generated images. While current AI-generated image detection methods assume the availability of real/AI-generated images for training, this is practically limited given the vast expressibility of LDMs. This motivates the training-free detection setup where no related data are available in advance. The existing LDM-generated image detection method assumes that images generated by LDM are easier to reconstruct using an autoencoder than real images. However, we observe that this reconstruction distance is overfitted to background information, leading the current method to underperform in detecting images with simple backgrounds. To address this, we propose a novel method called HFI. Specifically, by viewing the autoencoder of LDM as a downsampling-upsampling kernel, HFI measures the extent of aliasing, a distortion of high-frequency information that appears in the reconstructed image. HFI is training-free, efficient, and consistently outperforms other training-free methods in detecting challenging images generated by various generative models. We also show that HFI can successfully detect the images generated from the specified LDM as a means of implicit watermarking. HFI outperforms the best baseline method while achieving magnitudes of
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 37 of its 58 references that are in the map. First posted on arXiv 30 Dec 2024.
Builds on
37 of 58 references.
Closest ancestors · 3
Same direction, newest first
- 2024How to Trace Latent Generative Model Generated Images without Artificial Watermark?22 May
- 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust31 May
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
Other references · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
22 more
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2019Making Convolutional Networks Shift-Invariant Againcited by 391
- 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
- 2020What makes fake images detectable? Understanding properties that generalizecited by 273
- 2023Self-Consuming Generative Models Go MADcited by 250
- 2024A Sanity Check for AI-generated Image Detectioncited by 189
- 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
- 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
- 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
- 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusioncited by 114
- 2023Exposing the Fake: Effective Diffusion-Generated Images Detectioncited by 48
- 2024RIGID: A Training-free and Model-Agnostic Framework for Robust AI-Generated Image Detectioncited by 36
- 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysiscited by 30
- 2021Impact of Aliasing on Generalization in Deep Convolutional Networkscited by 25
- 2024Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Learningcited by 20
- 2024When Semantic Segmentation Meets Frequency Aliasingcited by 10
- 2023Improving Feature Stability during Upsampling -- Spectral Artifacts and the Importance of Spatial Contextcited by 8
Built on by
Citing papers per year: 2025: 4; 2026: 5.
9 papers.
- 2025Bridging the Gap Between Ideal and Real-world Evaluation: Benchmarking AI-Generated Image Detection in Challenging Scenarioscited by 24
- 2026SLICE: Semantic Latent Injection via Compartmentalized Embedding for Image Watermarkingcited by 7
- 2025AEDR: Training-Free AI-Generated Image Attribution via Autoencoder Double-Reconstructioncited by 5
- 2026How Fragile Are Training-Free AI-Generated Image Detectors? A Controlled Audit of Score Direction, Preprocessing, and Compressioncited by 2
- 2025EIRES:Training-free AI-Generated Image Detection via Edit-Induced Reconstruction Error Shiftcited by 1
- 2025PRADA: Probability-Ratio-Based Attribution and Detection of Autoregressive-Generated Imagescited by 1
- 2026Efficient Zero-Shot AI-Generated Image Detectioncited by 0
- 2026Training-Free Reconstruction-Based AI-Generated Image Detectors Are Inherently Vulnerable to Adversarial Examplescited by 0
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Expertscited by 0
- 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts24 Aug 2026
- 2026Training-Free Reconstruction-Based AI-Generated Image Detectors Are Inherently Vulnerable to Adversarial Examples17 Aug 2026
- 2026How Fragile Are Training-Free AI-Generated Image Detectors? A Controlled Audit of Score Direction, Preprocessing, and Compression18 Jun 2026
- 2026Efficient Zero-Shot AI-Generated Image Detection23 Mar 2026
- 2026SLICE: Semantic Latent Injection via Compartmentalized Embedding for Image Watermarking13 Mar 2026
- 2025PRADA: Probability-Ratio-Based Attribution and Detection of Autoregressive-Generated Images25 Nov 2025
- 2025EIRES:Training-free AI-Generated Image Detection via Edit-Induced Reconstruction Error Shift29 Oct 2025
- 2025Bridging the Gap Between Ideal and Real-world Evaluation: Benchmarking AI-Generated Image Detection in Challenging Scenarios11 Sep 2025
- 2025AEDR: Training-Free AI-Generated Image Attribution via Autoencoder Double-Reconstruction25 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Models
- 2024Detecting AutoEncoder is Enough to Catch LDM Generated Images
- 2024Aligned Datasets Improve Detection of Latent Diffusion-Generated Images
- 2023Diffusion Noise Feature: Accurate and Fast Generated Image Detection
- 2025TraceMark-LDM: Authenticatable Watermarking for Latent Diffusion Models via Binary-Guided Rearrangement
- 2024SAT-LDM: Provably Generalizable Image Watermarking for Latent Diffusion Models with Self-Augmented Training
- 2024Latent Watermark: Inject and Detect Watermarks in Latent Diffusion Space
- 2024DiffuseTrace: A Transparent and Flexible Watermarking Scheme for Latent Diffusion Model