mlsanityData to 7 Oct 2026

Importance-Aware OBS Pruning for Diffusion Models

arXiv 2607.20048 ↗First posted 22 Jul 2026cs.CVcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

We propose importance-aware pruning for diffusion models, a training-free framework that prioritizes preserving parameters critical to semantically salient image regions. To do so, we incorporate spatial importance maps -- derived from conditioning signals or model attention -- into the pruning objective. This produces parameter rankings aligned with perceptual relevance rather than uniform reconstruction error. On MS-COCO dataset, our proposed approach consistently retains subject fidelity and structural correctness at high compression ratios where conventional pruning causes visible degradation. These results demonstrate that content-aware objectives are key to perceptually faithful compression of generative models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 96 of its 109 references that are in the map. First posted on arXiv 22 Jul 2026.

Builds on

96 of 109 references.

Closest ancestors · 44

Same direction, newest first

  1. 2025OBS-Diff: Accurate Pruning For Diffusion Models in One-Shot8 Oct
  2. 2025ToMA: Token Merge with Attention for Diffusion Models13 Sep
  3. 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer30 Jan
  4. 2024Efficient Scaling of Diffusion Transformers for Text-to-Image Generation16 Dec
  5. 2024TinyFusion: Diffusion Transformers Learned Shallow2 Dec
  6. 2024Importance-Based Token Merging for Efficient Image and Video Generation23 Nov
  7. 2024DiP-GO: A Diffusion Pruner via Few-step Gradient Optimization22 Oct
  8. 2024Dynamic Diffusion Transformer4 Oct
  9. 2024VQ4DiT: Efficient Post-Training Vector Quantization for Diffusion Transformers30 Aug
  10. 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers25 Jun
  11. 2024Guiding a Diffusion Model with a Bad Version of Itself4 Jun
  12. 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers3 Jun
32 more
  1. 2024Attention-Driven Training-Free Efficiency Enhancement of Diffusion Models8 May
  2. 2024LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insights18 Apr
  3. 2024LAPTOP-Diff: Layer Pruning and Normalized Distillation for Compressing Diffusion Models17 Apr
  4. 2024SparseDM: Toward Sparse Efficient Diffusion Models16 Apr
  5. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation7 Mar
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
  7. 2024ToDo: Token Downsampling for Efficient Generation of High-Resolution Images21 Feb
  8. 2024QuEST: Low-bit Diffusion Model Quantization via Efficient Selective Finetuning6 Feb
  9. 2023Clockwork Diffusion: Efficient Generation With Model-Step Distillation13 Dec
  10. 2023FRDiff : Feature Reuse for Universal Training-free Acceleration of Diffusion Models6 Dec
  11. 2023Cache Me if You Can: Accelerating Diffusion Models through Block Caching6 Dec
  12. 2023DeepCache: Accelerating Diffusion Models for Free1 Dec
  13. 2023Adversarial Diffusion Distillation28 Nov
  14. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference6 Oct
  15. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis30 Sep
  16. 2023Temporal Dynamic Quantization for Diffusion Models4 Jun
  17. 2023Structural Pruning for Diffusion Models18 May
  18. 2023PTQD: Accurate Post-Training Quantization for Diffusion Models18 May
  19. 2023Token Merging for Fast Stable Diffusion30 Mar
  20. 2023Consistency Models2 Mar
  21. 2023Q-Diffusion: Quantizing Diffusion Models8 Feb
  22. 2022Scalable Diffusion Models with Transformers19 Dec
  23. 2022Diffusion Probabilistic Model Made Slim27 Nov
  24. 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
  25. 2022On Distillation of Guided Diffusion Models6 Oct
  26. 2022Classifier-Free Diffusion Guidance26 Jul
  27. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  28. 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
  29. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
  30. 2021Diffusion Models Beat GANs on Image Synthesis11 May
  31. 2020Denoising Diffusion Implicit Models6 Oct
  32. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 52

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  3. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  5. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  6. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  9. 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
  10. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  11. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  12. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
38 more
  1. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  2. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  3. 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,090
  4. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  5. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  6. 2022Token Merging: Your ViT But Fastercited by 995
  7. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  8. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  9. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  10. 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
  11. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  12. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  13. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  14. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  15. 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
  16. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
  17. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  18. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
  19. 2022Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruningcited by 317
  20. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
  21. 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
  22. 2017Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain Surgeoncited by 219
  23. 2023RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Pathscited by 141
  24. 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
  25. 2023Token Fusion: Bridging the Gap between Token Pruning and Token Mergingcited by 123
  26. 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 115
  27. 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 111
  28. 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 100
  29. 20223DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Modelscited by 57
  30. 2024Adversarial Diffusion Compression for Real-World Image Super-Resolutioncited by 49
  31. 2023Learned representation-guided diffusion models for large-image generationcited by 39
  32. 2024Looking Backward: Streaming Video-to-Video Translation with Feature Bankscited by 38
  33. 2024Object-Centric Diffusion for Efficient Video Editingcited by 31
  34. 2023High-fidelity Person-centric Subject-to-Image Synthesiscited by 21
  35. 2023MagicFusion: Boosting Text-to-Image Generation Performance by Fusing Diffusion Modelscited by 16
  36. 2025Exploring the Deep Fusion of Large Language Models and Diffusion Transformers for Text-to-Image Synthesiscited by 15
  37. 2024Not All Prompts Are Made Equal: Prompt-based Pruning of Text-to-Image Diffusion Modelscited by 13
  38. 2024Agglomerative Token Clusteringcited by 13

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Which Layer Causes Distribution Deviation? Entropy-Guided Adaptive Pruning for Diffusion and Flow Models
  2. 2024Diffusion Models Need Visual Priors for Image Generation
  3. 2024Learnable Sparsity for Vision Generative Models
  4. 2025HierarchicalPrune: Position-Aware Compression for Large-Scale Diffusion Models
  5. 2026Region-Adaptive Generative Compression with Spatially Varying Diffusion Models
  6. 2024On Improved Conditioning Mechanisms and Pre-training Strategies for Diffusion Models
  7. 2025Residual Prior Diffusion: A Probabilistic Framework Integrating Coarse Latent Priors with Diffusion Models
  8. 2026CoReDiT: Spatial Coherence-Guided Token Pruning and Reconstruction for Efficient Diffusion Transformers