mlsanityData to 14 Oct 2026

HFI: A unified framework for training-free detection and implicit watermarking of latent diffusion model generated images

arXiv 2412.20704 ↗First posted 30 Dec 2024cs.CV cs.LGcited by 9

On the map: Diffusion models → Robustness, privacy and adversarial aspects

also in 1 more
Abstract (arXiv)

Dramatic advances in the quality of the latent diffusion models (LDMs) also led to the malicious use of AI-generated images. While current AI-generated image detection methods assume the availability of real/AI-generated images for training, this is practically limited given the vast expressibility of LDMs. This motivates the training-free detection setup where no related data are available in advance. The existing LDM-generated image detection method assumes that images generated by LDM are easier to reconstruct using an autoencoder than real images. However, we observe that this reconstruction distance is overfitted to background information, leading the current method to underperform in detecting images with simple backgrounds. To address this, we propose a novel method called HFI. Specifically, by viewing the autoencoder of LDM as a downsampling-upsampling kernel, HFI measures the extent of aliasing, a distortion of high-frequency information that appears in the reconstructed image. HFI is training-free, efficient, and consistently outperforms other training-free methods in detecting challenging images generated by various generative models. We also show that HFI can successfully detect the images generated from the specified LDM as a means of implicit watermarking. HFI outperforms the best baseline method while achieving magnitudes of

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 37 of its 58 references that are in the map. First posted on arXiv 30 Dec 2024.

Builds on

37 of 58 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024How to Trace Latent Generative Model Generated Images without Artificial Watermark?22 May
  2. 2023Tree-Ring Watermarks: Fingerprints for Diffusion Images that are Invisible and Robust31 May
  3. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar

Other references · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  10. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  11. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  12. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
22 more
  1. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
  2. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  3. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  4. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 774
  5. 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
  6. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
  7. 2019Making Convolutional Networks Shift-Invariant Againcited by 391
  8. 2023GenImage: A Million-Scale Benchmark for Detecting AI-Generated Imagecited by 321
  9. 2020What makes fake images detectable? Understanding properties that generalizecited by 273
  10. 2023Self-Consuming Generative Models Go MADcited by 250
  11. 2024A Sanity Check for AI-generated Image Detectioncited by 189
  12. 2021Frequency-aware Discriminative Feature Learning Supervised by Single-Center Loss for Face Forgery Detectioncited by 134
  13. 2024AEROBLADE: Training-Free Detection of Latent Diffusion Images Using Autoencoder Reconstruction Errorcited by 125
  14. 2022Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmarkcited by 114
  15. 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusioncited by 114
  16. 2023Exposing the Fake: Effective Diffusion-Generated Images Detectioncited by 48
  17. 2024RIGID: A Training-free and Model-Agnostic Framework for Robust AI-Generated Image Detectioncited by 36
  18. 2024DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysiscited by 30
  19. 2021Impact of Aliasing on Generalization in Deep Convolutional Networkscited by 25
  20. 2024Frequency-Aware Deepfake Detection: Improving Generalizability through Frequency Space Learningcited by 20
  21. 2024When Semantic Segmentation Meets Frequency Aliasingcited by 10
  22. 2023Improving Feature Stability during Upsampling -- Spectral Artifacts and the Importance of Spatial Contextcited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 5.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Models
  2. 2024Detecting AutoEncoder is Enough to Catch LDM Generated Images
  3. 2024Aligned Datasets Improve Detection of Latent Diffusion-Generated Images
  4. 2023Diffusion Noise Feature: Accurate and Fast Generated Image Detection
  5. 2025TraceMark-LDM: Authenticatable Watermarking for Latent Diffusion Models via Binary-Guided Rearrangement
  6. 2024SAT-LDM: Provably Generalizable Image Watermarking for Latent Diffusion Models with Self-Augmented Training
  7. 2024Latent Watermark: Inject and Detect Watermarks in Latent Diffusion Space
  8. 2024DiffuseTrace: A Transparent and Flexible Watermarking Scheme for Latent Diffusion Model