Importance-Aware OBS Pruning for Diffusion Models
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
We propose importance-aware pruning for diffusion models, a training-free framework that prioritizes preserving parameters critical to semantically salient image regions. To do so, we incorporate spatial importance maps -- derived from conditioning signals or model attention -- into the pruning objective. This produces parameter rankings aligned with perceptual relevance rather than uniform reconstruction error. On MS-COCO dataset, our proposed approach consistently retains subject fidelity and structural correctness at high compression ratios where conventional pruning causes visible degradation. These results demonstrate that content-aware objectives are key to perceptually faithful compression of generative models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 96 of its 109 references that are in the map. First posted on arXiv 22 Jul 2026.
Builds on
96 of 109 references.
Closest ancestors · 44
Same direction, newest first
- 2025OBS-Diff: Accurate Pruning For Diffusion Models in One-Shot8 Oct
- 2025ToMA: Token Merge with Attention for Diffusion Models13 Sep
- 2025SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer30 Jan
- 2024Efficient Scaling of Diffusion Transformers for Text-to-Image Generation16 Dec
- 2024TinyFusion: Diffusion Transformers Learned Shallow2 Dec
- 2024Importance-Based Token Merging for Efficient Image and Video Generation23 Nov
- 2024DiP-GO: A Diffusion Pruner via Few-step Gradient Optimization22 Oct
- 2024Dynamic Diffusion Transformer4 Oct
- 2024VQ4DiT: Efficient Post-Training Vector Quantization for Diffusion Transformers30 Aug
- 2024Q-DiT: Accurate Post-Training Quantization for Diffusion Transformers25 Jun
- 2024Guiding a Diffusion Model with a Bad Version of Itself4 Jun
- 2024Delta-DiT: A Training-Free Acceleration Method Tailored for Diffusion Transformers3 Jun
32 more
- 2024Attention-Driven Training-Free Efficiency Enhancement of Diffusion Models8 May
- 2024LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insights18 Apr
- 2024LAPTOP-Diff: Layer Pruning and Normalized Distillation for Compressing Diffusion Models17 Apr
- 2024SparseDM: Toward Sparse Efficient Diffusion Models16 Apr
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation7 Mar
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesis5 Mar
- 2024ToDo: Token Downsampling for Efficient Generation of High-Resolution Images21 Feb
- 2024QuEST: Low-bit Diffusion Model Quantization via Efficient Selective Finetuning6 Feb
- 2023Clockwork Diffusion: Efficient Generation With Model-Step Distillation13 Dec
- 2023FRDiff : Feature Reuse for Universal Training-free Acceleration of Diffusion Models6 Dec
- 2023Cache Me if You Can: Accelerating Diffusion Models through Block Caching6 Dec
- 2023DeepCache: Accelerating Diffusion Models for Free1 Dec
- 2023Adversarial Diffusion Distillation28 Nov
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inference6 Oct
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis30 Sep
- 2023Temporal Dynamic Quantization for Diffusion Models4 Jun
- 2023Structural Pruning for Diffusion Models18 May
- 2023PTQD: Accurate Post-Training Quantization for Diffusion Models18 May
- 2023Token Merging for Fast Stable Diffusion30 Mar
- 2023Consistency Models2 Mar
- 2023Q-Diffusion: Quantizing Diffusion Models8 Feb
- 2022Scalable Diffusion Models with Transformers19 Dec
- 2022Diffusion Probabilistic Model Made Slim27 Nov
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Models2 Nov
- 2022On Distillation of Guided Diffusion Models6 Oct
- 2022Classifier-Free Diffusion Guidance26 Jul
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
- 2022Pseudo Numerical Methods for Diffusion Models on Manifolds20 Feb
- 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec
- 2021Diffusion Models Beat GANs on Image Synthesis11 May
- 2020Denoising Diffusion Implicit Models6 Oct
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 52
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 1,998
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
38 more
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2023SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shotcited by 1,090
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2022Token Merging: Your ViT But Fastercited by 995
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
- 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2023Zero123++: a Single Image to Consistent Multi-view Diffusion Base Modelcited by 516
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 323
- 2022Optimal Brain Compression: A Framework for Accurate Post-Training Quantization and Pruningcited by 317
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 294
- 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
- 2017Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain Surgeoncited by 219
- 2023RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Pathscited by 141
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
- 2023Token Fusion: Bridging the Gap between Token Pruning and Token Mergingcited by 123
- 2024FasterCache: Training-Free Video Diffusion Model Acceleration with High Qualitycited by 115
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editingcited by 111
- 2024Adaptive Caching for Faster Video Generation with Diffusion Transformerscited by 100
- 20223DDesigner: Towards Photorealistic 3D Object Generation and Editing with Text-guided Diffusion Modelscited by 57
- 2024Adversarial Diffusion Compression for Real-World Image Super-Resolutioncited by 49
- 2023Learned representation-guided diffusion models for large-image generationcited by 39
- 2024Looking Backward: Streaming Video-to-Video Translation with Feature Bankscited by 38
- 2024Object-Centric Diffusion for Efficient Video Editingcited by 31
- 2023High-fidelity Person-centric Subject-to-Image Synthesiscited by 21
- 2023MagicFusion: Boosting Text-to-Image Generation Performance by Fusing Diffusion Modelscited by 16
- 2025Exploring the Deep Fusion of Large Language Models and Diffusion Transformers for Text-to-Image Synthesiscited by 15
- 2024Not All Prompts Are Made Equal: Prompt-based Pruning of Text-to-Image Diffusion Modelscited by 13
- 2024Agglomerative Token Clusteringcited by 13
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Which Layer Causes Distribution Deviation? Entropy-Guided Adaptive Pruning for Diffusion and Flow Models
- 2024Diffusion Models Need Visual Priors for Image Generation
- 2024Learnable Sparsity for Vision Generative Models
- 2025HierarchicalPrune: Position-Aware Compression for Large-Scale Diffusion Models
- 2026Region-Adaptive Generative Compression with Spatially Varying Diffusion Models
- 2024On Improved Conditioning Mechanisms and Pre-training Strategies for Diffusion Models
- 2025Residual Prior Diffusion: A Probabilistic Framework Integrating Coarse Latent Priors with Diffusion Models
- 2026CoReDiT: Spatial Coherence-Guided Token Pruning and Reconstruction for Efficient Diffusion Transformers