mlsanityData to 7 Oct 2026

A Causal Diffusion Model for Video Reconstruction from Ultra-Low-Bitrate Representations

arXiv 2602.13837 ↗First posted 14 Feb 2026cs.CVcited by 0

On the map: Diffusion models → Diffusion for compression and wireless

Abstract (arXiv)

We study video reconstruction from ultra-low-bitrate representations, where the primary challenge shifts from encoding to decoding. In this regime, reconstruction with classical and neural codecs introduces blur, while generative and semantic approaches often struggle to jointly preserve fidelity, temporal consistency, and perceptual quality. To address these limitations, we propose a causal video diffusion model that reconstructs videos from ultra-low-bitrate semantics and highly compressed frames by jointly modeling their complementary information. We further introduce temporal-only distillation from a bidirectional teacher to enable parameter-efficient training and causal few-step inference. Through extensive quantitative, qualitative, and subjective evaluation, we show that the proposed method outperforms classical, neural, generative, and semantic baselines in ultra-low-bitrate video reconstruction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion for compression and wireless, one of 14 directions in Diffusion models. Builds on 57 of its 70 references that are in the map. First posted on arXiv 14 Feb 2026.

Builds on

57 of 70 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025StableCodec: Taming One-Step Diffusion for Extreme Image Compression27 Jun
  2. 2025Diffusion-based Perceptual Neural Video Compression with Temporal Diffusion Information Reuse23 Jan
  3. 2024Lightweight Diffusion Models for Resource-Constrained Semantic Communication3 Oct
  4. 2023Diffusion models for audio semantic communication13 Sep

Other references · 53

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2020Denoising Diffusion Implicit Modelscited by 9,655
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  8. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  9. 2022Scalable Diffusion Models with Transformerscited by 5,931
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  11. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  12. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
38 more
  1. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  4. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  5. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  6. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  7. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  8. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  9. 2018Variational image compression with a scale hyperpriorcited by 910
  10. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
  11. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  12. 2016End-to-end Optimized Image Compressioncited by 673
  13. 2017The Perception-Distortion Tradeoffcited by 582
  14. 2024From Slow Bidirectional to Fast Autoregressive Video Diffusion Modelscited by 401
  15. 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 369
  16. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 332
  17. 2020High-Fidelity Generative Image Compressioncited by 331
  18. 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 324
  19. 2020Deep Learning Enabled Semantic Communication Systemscited by 282
  20. 2021Deep Contextual Video Compressioncited by 216
  21. 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 213
  22. 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 149
  23. 2015Benchmarking in Manipulation Research: The YCB Object and Model Set and Benchmarking Protocolscited by 98
  24. 2025Towards Practical Real-Time Neural Video Compressioncited by 72
  25. 2023I2V-Adapter: A General Image-to-Video Adapter for Diffusion Modelscited by 70
  26. 2021Perceptual Learned Video Compression with Recurrent Conditional GANcited by 38
  27. 2022Towards Semantic Communications: Deep Learning-Based Image Semantic Codingcited by 35
  28. 2019Learned Video Compression via Joint Spatial-Temporal Correlation Explorationcited by 28
  29. 2020Ultra-low bitrate video conferencing using deep image animationcited by 22
  30. 2025Generative Latent Coding for Ultra-Low Bitrate Image and Video Compressioncited by 22
  31. 2025Generative Latent Coding for Ultra-Low Bitrate Image Compressioncited by 21
  32. 2021DVC-P: Deep Video Compression with Perceptual Optimizationscited by 13
  33. 2023Deep Hierarchical Video Compressioncited by 9
  34. 2024M3-CVC: Controllable Video Compression with Multimodal Generative Modelscited by 9
  35. 2025Generative Video Semantic Communication via Multimodal Semantic Fusion with Large Modelcited by 9
  36. 2025DiffVC-OSD: One-Step Diffusion-based Perceptual Neural Video Compression Frameworkcited by 9
  37. 2025T-GVC: Trajectory-Guided Generative Video Coding at Ultra-Low Bitratescited by 8
  38. 2025Generative Latent Video Compressioncited by 8

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Diffusion-aided Extreme Video Compression with Lightweight Semantics Guidance
  2. 2025Low-Bitrate Video Compression through Semantic-Conditioned Diffusion
  3. 2026Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion
  4. 2026Next-Frame Decoding for Ultra-Low-Bitrate Image Compression with Video Diffusion Priors
  5. 2026Efficient Video Diffusion with Sparse Information Transmission for Video Compression
  6. 2026Exploiting Semantic and Pixel Representations for Ultra-Low Bitrate Image Compression
  7. 2025Conditional Video Generation for High-Efficiency Video Compression
  8. 2025Ultra Lowrate Image Compression with Semantic Residual Coding and Compression-aware Diffusion