mlsanityData to 7 Oct 2026

Hiding Images in Diffusion Models by Editing Learned Score Functions

arXiv 2503.18459 ↗First posted 24 Mar 2025cs.CVcited by 2

On the map: Diffusion models → Robustness, privacy and adversarial aspects

Abstract (arXiv)

Hiding data using neural networks (i.e., neural steganography) has achieved remarkable success across both discriminative classifiers and generative adversarial networks. However, the potential of data hiding in diffusion models remains relatively unexplored. Current methods exhibit limitations in achieving high extraction accuracy, model fidelity, and hiding efficiency due primarily to the entanglement of the hiding and extraction processes with multiple denoising diffusion steps. To address these, we describe a simple yet effective approach that embeds images at specific timesteps in the reverse diffusion process by editing the learned score functions. Additionally, we introduce a parameter-efficient fine-tuning method that combines gradient-based parameter selection with low-rank adaptation to enhance model fidelity and hiding efficiency. Comprehensive experiments demonstrate that our method extracts high-quality images at human-indistinguishable levels, replicates the original model behaviors at both sample and population levels, and embeds images orders of magnitude faster than prior methods. Besides, our method naturally supports multi-recipient scenarios through independent extraction channels.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 63 of its 90 references that are in the map. First posted on arXiv 24 Mar 2025.

Builds on

63 of 90 references.

Closest ancestors · 9

Same direction, newest first

  1. 2024AquaLoRA: Toward White-box Protection for Customized Stable Diffusion Models via Watermark LoRA18 May
  2. 2023VillanDiffusion: A Unified Backdoor Attack Framework for Diffusion Models12 Jun
  3. 2023Intellectual Property Protection of Diffusion Models via the Watermark Diffusion Process6 Jun
  4. 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
  5. 2023Ablating Concepts in Text-to-Image Diffusion Models23 Mar
  6. 2023A Recipe for Watermarking Diffusion Models17 Mar
  7. 2023Erasing Concepts from Diffusion Models13 Mar
  8. 2023TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targets10 Mar
  9. 2022How to Backdoor Diffusion Models?11 Dec

Other references · 54

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  8. 2020Denoising Diffusion Implicit Modelscited by 9,655
  9. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  10. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  11. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  12. 2022Scalable Diffusion Models with Transformerscited by 5,931
38 more
  1. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  3. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  4. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  5. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  6. 2023Consistency Modelscited by 1,778
  7. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  8. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
  9. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  10. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  11. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  12. 2023Adversarial Diffusion Distillationcited by 741
  13. 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 740
  14. 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
  15. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
  16. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  17. 2018HiDDeN: Hiding Data With Deep Networkscited by 384
  18. 2019Sliced Score Matching: A Scalable Approach to Density and Score Estimationcited by 381
  19. 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 365
  20. 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
  21. 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 337
  22. 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
  23. 2024PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Modelscited by 261
  24. 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 231
  25. 2023ReLoRA: High-Rank Training Through Low-Rank Updatescited by 200
  26. 2017Machine Learning Models that Remember Too Muchcited by 165
  27. 2021FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learningcited by 140
  28. 2024LoRA-GA: Low-Rank Adaptation with Gradient Approximationcited by 134
  29. 2022KronA: Parameter Efficient Tuning with Kronecker Adaptercited by 130
  30. 2023Navigating Text-To-Image Customization: From LyCORIS Fine-Tuning to Model Evaluationcited by 108
  31. 2023Sensitivity-Aware Visual Parameter-Efficient Fine-Tuningcited by 74
  32. 2024LoRA-Pro: Are Low-Rank Adapters Properly Optimized?cited by 70
  33. 2020Model Watermarking for Image Processing Networkscited by 49
  34. 2023Gradient-based Parameter Selection for Efficient Fine-Tuningcited by 40
  35. 2022Supervised GAN Watermarking for Intellectual Property Protectioncited by 39
  36. 2021EvilModel: Hiding Malware Inside of Neural Network Modelscited by 15
  37. 2024Editing Massive Concepts in Text-to-Image Diffusion Modelscited by 15
  38. 2022Hiding Images in Deep Probabilistic Modelscited by 5

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Embedding Hidden Adversarial Capabilities in Pre-Trained Diffusion Models
  2. 2023CRoSS: Diffusion Model Makes Controllable, Robust and Secure Image Steganography
  3. 2023Diffusion-Stego: Training-free Diffusion Generative Steganography via Message Projection
  4. 2023Unlearnable Examples for Diffusion Models: Protect Data from Unauthorized Exploitation
  5. 2025Demystifying Adversarial Robustness in Diffusion Models: Compression, Randomness, and Geometry
  6. 2023Masked Diffusion Models Are Fast Distribution Learners
  7. 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoders
  8. 2025PSyDUCK: Training-Free Steganography for Latent Diffusion