mlsanityData to 7 Oct 2026

SelfLift: Accelerating Few-Step Diffusion via Self-Recovering Resolution Transition

arXiv 2609.02036 ↗First posted 2 Sep 2026cs.CVcited by 0

On the map: Diffusion models → Diffusion foundations and sampling

Abstract (arXiv)

Few-step diffusion models substantially compress temporal computation, making the spatial cost of each model evaluation an increasingly dominant source of inference latency. Progressive-resolution inference reduces this cost by performing early denoising at low resolution and reserving high-resolution computation for refinement. However, existing methods typically lift intermediate latents directly and rely on subsequent steps to absorb the induced distribution mismatch. In the few-step regime, the limited recovery budget leaves these errors as visible artifacts, constraining how late the transition can occur and, consequently, how efficiently it can be performed. We introduce SelfLift, a self-recovering progressive-resolution framework that derives both transition-repair signals and trajectory-aligned supervision from the generative model itself. SelfLift-zero proposes a training-free Artifact-Aware Consistency Lift, using disagreement between direct latent lifting and pixel-VAE re-encoding as both a localized artifact-risk signal and a model-native correction direction. It enables reliable late transitions without external super-resolution, extra denoiser evaluations, or sampling-schedule modifications. Building on this robust transition, SelfLift-rich performs On-Policy Self Recovery on student-visited states, transferring dense high-resolution guidance from an internal self-teacher while remaining aligned with the altered progressive-resolution dynamics. Across FLUX.2-Klein and Z-Image-Turbo, SelfLift reduces end-to-end latency by 41.5% and 44.1%, respectively. Combined with timestep distillation, it delivers overall speedups of 29.61x and 19.21x over the corresponding 50-step models while preserving competitive generation quality, establishing a stronger speed-quality frontier for few-step diffusion.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 38 of its 39 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

38 of 39 references.

Closest ancestors · 19

Same direction, newest first

  1. 2026D-OPSD: On-Policy Self-Distillation for Continuously Tuning Step-Distilled Diffusion Models6 May
  2. 20261.x-Distill: Breaking the Diversity, Quality, and Efficiency Barrier in Distribution Matching Distillation5 Apr
  3. 2025No Cache Left Idle: Accelerating diffusion model via Extreme-slimming Caching14 Dec
  4. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformer27 Nov
  5. 2025ERTACache: Error Rectification and Timesteps Adjustment for Efficient Diffusion27 Aug
  6. 2025Fewer Denoising Steps or Cheaper Per-Step Inference: Towards Compute-Optimal Diffusion Model Deployment8 Aug
  7. 2025Training-free Mixed-Resolution Latent Upsampling for Spatially Accelerated Diffusion Transformers11 Jul
  8. 2025Pyramidal Patchification Flow for Visual Generation30 Jun
  9. 2025Training-free Diffusion Acceleration with Bottleneck Sampling24 Mar
  10. 2025From Reusing to Forecasting: Accelerating Diffusion Models with TaylorSeers10 Mar
  11. 2024Tuning Timestep-Distilled Diffusion Model Using Pairwise Sample Optimization4 Oct
  12. 2024Improved Distribution Matching Distillation for Fast Image Synthesis23 May
7 more
  1. 2024Boosting Diffusion Models with Moving Average Sampling in Frequency Domain26 Mar
  2. 2023One-step Diffusion with Distribution Matching Distillation30 Nov
  3. 2023Consistency Models2 Mar
  4. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Models9 Feb
  5. 2022Scalable Diffusion Models with Transformers19 Dec
  6. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Steps2 Jun
  7. 2021High-Resolution Image Synthesis with Latent Diffusion Models20 Dec

Other references · 19

  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  3. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  4. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  5. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  6. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  7. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  8. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
  9. 2023On-Policy Distillation of Language Models: Learning from Self-Generated Mistakescited by 840
  10. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  11. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  12. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
7 more
  1. 2024Timestep Embedding Tells: It's Time to Cache for Video Diffusion Modelcited by 245
  2. 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillationcited by 109
  3. 2026DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Modelscited by 35
  4. 2026Flow-OPD: On-Policy Distillation for Flow Matching Modelscited by 29
  5. 2025Latent Space Super-Resolution for Higher-Resolution Image Generation with Diffusion Modelscited by 24
  6. 2026Motion-Aware Caching for Efficient Autoregressive Video Generationcited by 2
  7. 2026Multi-Resolution Flow Matching: Training-Free Diffusion Acceleration via Staged Samplingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Bridging Restoration and Generation in One-step Diffusion for Real-World Image Super-Resolution
  2. 2026FastDiSS: Few-step Match Many-step Diffusion Language Model on Sequence-to-Sequence Generation--Full Version
  3. 2025Ctrl-Z Sampling: Scaling Diffusion Sampling with Controlled Random Zigzag Explorations
  4. 2026SOAR: Self-Correction for Optimal Alignment and Refinement in Diffusion Models
  5. 2025Fine-Tuning Masked Diffusion for Provable Self-Correction
  6. 2026Generalized Discrete Diffusion with Self-Correction
  7. 2026Inference-Time Scaling of Diffusion Models via Progressive Seed Pruning
  8. 2026Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models