Controlling Polar Exposure to Delay Memorization in Diffusion Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Diffusion models can reach useful sample quality before copying training examples, but fast optimization can compress this generalization window by accelerating sample-specific fitting. We investigate this effect through update geometry and propose Quality-Gated De-whitening (QGD), a controller that retains a fast polar-update prefix and progressively restores fixed-gain momentum. Our random-feature analysis separates covariance-controlled, curvature-equalized and amplitude-controlled memorization clocks. Under aligned spectral assumptions, it establishes a finite-exposure condition under which a fixed-gain tail recovers a delay proportional to dataset size. QGD implements this principle with a confirmed quality gate, a bounded decay envelope and causal copy feedback. Immediate switching is the conservative limit; gradual control balances delayed copying against continued quality improvement. We pair QGD with Copy-Budgeted Selection (CBS), which applies simultaneous binomial calibration to a frozen checkpoint family, followed by a fresh evaluation of the released checkpoint. On 2,000-image CIFAR-10 subsets, QGD preserves the polar baseline's quality-arrival time while expanding its useful interval by 8.32x and reducing common-checkpoint copying by 75.9%. With identical calibration and independent quality evaluation, QGD achieves FID 75.56 versus 79.37 for SGD with the same selector. Exposure-matched controls, independent detector audits and transfer to flow matching and dance generation support adaptive exposure control as a practical way to improve the quality-copying tradeoff.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. First posted on arXiv 2 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Memorization Control in Diffusion Models from Denoising-centric Perspective
- 2025Ctrl-Z Sampling: Scaling Diffusion Sampling with Controlled Random Zigzag Explorations
- 2026Detecting and Mitigating Memorization in Diffusion Models through Anisotropy of the Log-Probability
- 2024Towards Memorization-Free Diffusion Models
- 2025Adjusting Initial Noise to Mitigate Memorization in Text-to-Image Diffusion Models
- 2026Broken Memories: Detecting and Mitigating Memorization in Diffusion Models with Degraded Generations
- 2026Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models
- 2024Imagine Flash: Accelerating Emu Diffusion Models with Backward Distillation