Single-step Diffusion-based Video Coding with Semantic-Temporal Guidance
On the map: Diffusion models → Diffusion for compression and wireless
Abstract (arXiv)
While traditional and neural video codecs (NVCs) have achieved remarkable rate-distortion performance, improving perceptual quality at low bitrates remains challenging. Some NVCs incorporate perceptual or adversarial objectives but still suffer from artifacts due to limited generation capacity, whereas others leverage pretrained diffusion models to improve quality at the cost of heavy sampling complexity. To overcome these challenges, we propose S2VC, a Single-Step diffusion based Video Codec that integrates a conditional coding framework with an efficient single-step diffusion generator, enabling realistic reconstruction at low bitrates with reduced sampling cost. Recognizing the importance of semantic conditioning in single-step diffusion, we introduce Contextual Semantic Guidance to extract frame-adaptive semantics from buffered features. It replaces text captions with efficient, fine-grained conditioning, thereby improving generation realism. In addition, Temporal Consistency Guidance is incorporated into the diffusion U-Net to enforce temporal coherence across frames and ensure stable generation. Extensive experiments show that S2VC delivers state-of-the-art perceptual quality with an average 52.73% bitrate saving over prior perceptual methods, underscoring the promise of single-step diffusion for efficient, high-quality video compression. Project: https://onedc-codec.github.io/s2vc/
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Diffusion for compression and wireless, one of 14 directions in Diffusion models. Builds on 41 of its 57 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
41 of 57 references.
Closest ancestors · 4
Same direction, newest first
- 2025StableCodec: Taming One-Step Diffusion for Extreme Image Compression27 Jun
- 2025One-Step Diffusion-Based Image Compression with Semantic Distillation22 May
- 2025Diffusion-based Perceptual Neural Video Compression with Temporal Diffusion Information Reuse23 Jan
- 2024Towards Extreme Image Compression with Latent Feature Guidance and Diffusion Prior29 Apr
Other references · 37
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2023Consistency Modelscited by 1,778
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2025DINOv3cited by 1,297
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
25 more
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
- 2020High-Fidelity Generative Image Compressioncited by 331
- 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 324
- 2021Deep Contextual Video Compressioncited by 216
- 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 212
- 2023Neural Video Compression with Diverse Contextscited by 155
- 2022Hybrid Spatial-Temporal Entropy Modelling for Neural Video Compressioncited by 123
- 2024Neural Video Compression with Feature Modulationcited by 115
- 2021Temporal Context Mining for Learned Video Compressioncited by 112
- 2023Towards image compression with perfect realism at ultra-low bitratescited by 99
- 2023Improving Statistical Fidelity for Neural Image Compression with Implicit Local Likelihood Modelscited by 90
- 2025Towards Practical Real-Time Neural Video Compressioncited by 72
- 2023EVC: Towards Real-Time Neural Image Compression with Mask Decaycited by 46
- 2021Perceptual Learned Video Compression with Recurrent Conditional GANcited by 38
- 2021Neural Video Compression using GANs for Detail Synthesis and Propagationcited by 35
- 2022FloLPIPS: A Bespoke Video Quality Metric for Frame Interpoationcited by 34
- 2025Generative Latent Coding for Ultra-Low Bitrate Image and Video Compressioncited by 22
- 2025DLF: Extreme Image Compression with Dual-generative Latent Fusioncited by 20
- 2024ECVC: Exploiting Non-Local Correlations in Multiple Frames for Contextual Video Compressioncited by 18
- 2025UltraVSR: Achieving Ultra-Realistic Video Super-Resolution with Efficient One-Step Diffusion Spacecited by 14
- 2025One-Step Diffusion for Detail-Rich and Temporally Consistent Video Super-Resolutioncited by 14
- 2021DVC-P: Deep Video Compression with Perceptual Optimizationscited by 13
- 2024I2VC: A Unified Framework for Intra- & Inter-frame Video Compressioncited by 10
- 2025DiffVC-OSD: One-Step Diffusion-based Perceptual Neural Video Compression Frameworkcited by 9
- 2023High Visual-Fidelity Learned Video Compressioncited by 7
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Ultra-Fast Neural Video Compressioncited by 3
- 2026DiffVC-RT: Towards Practical Real-Time Diffusion-based Perceptual Neural Video Compressioncited by 1
- 2026Generative Video Compression with One-Dimensional Latent Representationcited by 1
- 2026ZeroGVC: Zero-Shot Generative Video Compression with Autoregressive Diffusion Priorscited by 1
- 2026Generative Video Compression with Adaptive Score Distillationcited by 1
- 2026CodecArena: Codec Quality Assessment via Visual Reinforcement Learningcited by 0
- 2026DiffVC-ONE: Diffusion-based Generative Video Compression with One-Step Video Diffusion Transformercited by 0
- 2026Information Capacity of Generative Video Compression: Quantifying the Rate-Compute Exchange at Identical Qualitycited by 0
- 2026Information Capacity of Generative Video Compression: Quantifying the Rate-Compute Exchange at Identical Quality23 Sep 2026
- 2026DiffVC-ONE: Diffusion-based Generative Video Compression with One-Step Video Diffusion Transformer20 Aug 2026
- 2026CodecArena: Codec Quality Assessment via Visual Reinforcement Learning10 Aug 2026
- 2026Generative Video Compression with Adaptive Score Distillation24 Jul 2026
- 2026ZeroGVC: Zero-Shot Generative Video Compression with Autoregressive Diffusion Priors21 Jun 2026
- 2026Ultra-Fast Neural Video Compression3 Jun 2026
- 2026Generative Video Compression with One-Dimensional Latent Representation16 Mar 2026
- 2026DiffVC-RT: Towards Practical Real-Time Diffusion-based Perceptual Neural Video Compression28 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Low-Bitrate Video Compression through Semantic-Conditioned Diffusion
- 2026Diffusion-aided Extreme Video Compression with Lightweight Semantics Guidance
- 2026Image-to-Video Diffusion: From Foundations to Open Frontiers
- 2022CaDM: Codec-aware Diffusion Modeling for Neural-enhanced Video Streaming
- 2025Conditional Video Generation for High-Efficiency Video Compression
- 2024M3-CVC: Controllable Video Compression with Multimodal Generative Models
- 2026DiV-INR: Extreme Low-Bitrate Diffusion Video Compression with INR Conditioning
- 2026A Causal Diffusion Model for Video Reconstruction from Ultra-Low-Bitrate Representations