Cyclic Denoising Reveals Ultrastable Memories in Diffusion Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
We introduce cyclic denoising -- repeated forward and reverse diffusion at controlled noise amplitudes -- as an extraction attack for image diffusion models. Inspired by random organization in disordered solids, cyclic denoising exposes regions of the learned distribution that are largely inaccessible to standard sampling. The dynamics drive samples toward attractors with a broad stability spectrum. The deepest attractors are ultrastable: they regenerate after near-total corruption and persist through thousands of noising-denoising cycles. Many of these attractors correspond to memorized training images, including stock photographs, brand watermarks, and web-crawl artifacts. The attack requires only sampler-level control, with no gradients, weight inspection, prompts, captions, or prior knowledge of the training data. Unlike generate-and-filter attacks, which rely on large-scale prompted generation and post-hoc similarity or membership-inference filtering, our main protocol is fully unconditioned. We demonstrate the phenomenon in Stable Diffusion v1.4 and in a pixel-space DDPM, showing consistent behavior across latent- and pixel-space diffusion models. Across noise amplitudes, we observe a yielding-like transition: low-amplitude cycling produces trivial absorbing fixed points or limit cycles, while larger amplitudes induce rearrangements, basin hopping, and long-lived trapping in structured memorized attractor basins. We also observe hierarchical partial absorption, prompt-stabilized basins, and cross-initial-condition universality of the recovered attractor set. Our results therefore show that cyclic denoising is both a physics-inspired probe of generative landscapes and a practical tool for memorization auditing, with implications for privacy, copyright compliance, and model fingerprinting.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 12 of its 16 references that are in the map. First posted on arXiv 22 Jun 2026.
Builds on
12 of 16 references.
Closest ancestors · 6
Same direction, newest first
- 2025Memorization to Generalization: Emergence of Diffusion Models from Associative Memory27 May
- 2025Why Diffusion Models Don't Memorize: The Role of Implicit Dynamical Regularization in Training23 May
- 2024A Phase Transition in Diffusion Models Reveals the Hierarchical Nature of Data26 Feb
- 2023Understanding and Mitigating Copying in Diffusion Models31 May
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 6
- 2023Extracting Training Data from Diffusion Modelscited by 732
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 424
- 2023A Reproducible Extraction of Training Images from Diffusion Modelscited by 61
- 2025Navigating the Latent Space Dynamics of Neural Modelscited by 8
- 2024SIDE: Surrogate Conditional Data Extraction from Diffusion Modelscited by 7
- 2024Self-organization and memory in an disordered solid subject to random loadingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026From Modes to Memories: Characterizing the Scale-Space Dynamics of Diffusion Models
- 2026Fractals made Practical: Denoising Diffusion as Partitioned Iterated Function Systems
- 2023Exploring Continual Learning of Diffusion Models
- 2026Early Signatures of Memorization in Diffusion Models via Basin Geometry and Cyclic Denoising
- 2026ASSERT: Adaptive Stochastic Sampling for Robust Diffusion Models on Analog Compute-in-Memory Hardware
- 2024Tracing the Roots: Leveraging Temporal Dynamics in Diffusion Trajectories for Origin Attribution
- 2024Diffusion Models as Cartoonists: The Curious Case of High Density Regions
- 2023Iterative α-(de)Blending: a Minimalist Deterministic Diffusion Model