Hiding Images in Diffusion Models by Editing Learned Score Functions
On the map: Diffusion models → Robustness, privacy and adversarial aspects
Abstract (arXiv)
Hiding data using neural networks (i.e., neural steganography) has achieved remarkable success across both discriminative classifiers and generative adversarial networks. However, the potential of data hiding in diffusion models remains relatively unexplored. Current methods exhibit limitations in achieving high extraction accuracy, model fidelity, and hiding efficiency due primarily to the entanglement of the hiding and extraction processes with multiple denoising diffusion steps. To address these, we describe a simple yet effective approach that embeds images at specific timesteps in the reverse diffusion process by editing the learned score functions. Additionally, we introduce a parameter-efficient fine-tuning method that combines gradient-based parameter selection with low-rank adaptation to enhance model fidelity and hiding efficiency. Comprehensive experiments demonstrate that our method extracts high-quality images at human-indistinguishable levels, replicates the original model behaviors at both sample and population levels, and embeds images orders of magnitude faster than prior methods. Besides, our method naturally supports multi-recipient scenarios through independent extraction channels.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Robustness, privacy and adversarial aspects, one of 14 directions in Diffusion models. Builds on 63 of its 90 references that are in the map. First posted on arXiv 24 Mar 2025.
Builds on
63 of 90 references.
Closest ancestors · 9
Same direction, newest first
- 2024AquaLoRA: Toward White-box Protection for Customized Stable Diffusion Models via Watermark LoRA18 May
- 2023VillanDiffusion: A Unified Backdoor Attack Framework for Diffusion Models12 Jun
- 2023Intellectual Property Protection of Diffusion Models via the Watermark Diffusion Process6 Jun
- 2023The Stable Signature: Rooting Watermarks in Latent Diffusion Models27 Mar
- 2023Ablating Concepts in Text-to-Image Diffusion Models23 Mar
- 2023A Recipe for Watermarking Diffusion Models17 Mar
- 2023Erasing Concepts from Diffusion Models13 Mar
- 2023TrojDiff: Trojan Attacks on Diffusion Models with Diverse Targets10 Mar
- 2022How to Backdoor Diffusion Models?11 Dec
Other references · 54
- 2017Attention Is All You Needcited by 59,932
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Scalable Diffusion Models with Transformerscited by 5,931
38 more
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2023Consistency Modelscited by 1,778
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
- 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,234
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2023Adversarial Diffusion Distillationcited by 741
- 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 740
- 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2019Sliced Score Matching: A Scalable Approach to Density and Score Estimationcited by 381
- 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 365
- 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
- 2023AdaLoRA: Adaptive Budget Allocation for Parameter-Efficient Fine-Tuningcited by 337
- 2018Turning Your Weakness Into a Strength: Watermarking Deep Neural Networks by Backdooringcited by 334
- 2024PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Modelscited by 261
- 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 231
- 2023ReLoRA: High-Rank Training Through Low-Rank Updatescited by 200
- 2017Machine Learning Models that Remember Too Muchcited by 165
- 2021FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learningcited by 140
- 2024LoRA-GA: Low-Rank Adaptation with Gradient Approximationcited by 134
- 2022KronA: Parameter Efficient Tuning with Kronecker Adaptercited by 130
- 2023Navigating Text-To-Image Customization: From LyCORIS Fine-Tuning to Model Evaluationcited by 108
- 2023Sensitivity-Aware Visual Parameter-Efficient Fine-Tuningcited by 74
- 2024LoRA-Pro: Are Low-Rank Adapters Properly Optimized?cited by 70
- 2020Model Watermarking for Image Processing Networkscited by 49
- 2023Gradient-based Parameter Selection for Efficient Fine-Tuningcited by 40
- 2022Supervised GAN Watermarking for Intellectual Property Protectioncited by 39
- 2021EvilModel: Hiding Malware Inside of Neural Network Modelscited by 15
- 2024Editing Massive Concepts in Text-to-Image Diffusion Modelscited by 15
- 2022Hiding Images in Deep Probabilistic Modelscited by 5
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Embedding Hidden Adversarial Capabilities in Pre-Trained Diffusion Models
- 2023CRoSS: Diffusion Model Makes Controllable, Robust and Secure Image Steganography
- 2023Diffusion-Stego: Training-free Diffusion Generative Steganography via Message Projection
- 2023Unlearnable Examples for Diffusion Models: Protect Data from Unauthorized Exploitation
- 2025Demystifying Adversarial Robustness in Diffusion Models: Compression, Randomness, and Geometry
- 2023Masked Diffusion Models Are Fast Distribution Learners
- 2022Truncated Diffusion Probabilistic Models and Diffusion-based Adversarial Auto-Encoders
- 2025PSyDUCK: Training-Free Steganography for Latent Diffusion