GVCC: Zero-Shot Video Compression via Codebook-Driven Stochastic Rectified Flow
On the map: Diffusion models → Diffusion for compression and wireless
Abstract (arXiv)
At ultra-low bitrates, high-fidelity reconstruction requires sampling plausible videos from the posterior rather than regressing to oversmoothed conditional means. We propose Generative Video Codebook Codec (GVCC), a zero-shot framework in which a pretrained video generative model serves directly as the decoder, and the transmitted bitstream specifies its generation trajectory. Modern rectified-flow video models are typically sampled with deterministic ODE solvers, which leave no per-step stochastic channel for transmitting compressed information. GVCC addresses this by converting the deterministic flow sampler into an equivalent marginal-preserving stochastic process, so that information can be transmitted by encoding the per-step stochastic innovations. Unlike images, videos introduce longer temporal dependencies and more diverse conditioning modes. We instantiate GVCC in three practical modes: Text-to-Video (T2V) without a reference frame, autoregressive Image-to-Video (I2V) with tail latent correction, and First-Last-Frame-to-Video (FLF2V) with boundary-sharing Group of Pictures (GOP) chaining. On the seven-sequence UVG dataset, local atom-count sweeps characterize the rate--quality behavior of all three variants. We report full-dataset perceptual and fidelity metrics together with temporal diagnostics, without inferring matched-rate or global RD improvements from these limited local sweeps.
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Placed in Diffusion for compression and wireless, one of 14 directions in Diffusion models. Builds on 52 of its 60 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
52 of 60 references.
Closest ancestors · 9
Same direction, newest first
- 2025Generative Neural Video Compression via Video Diffusion Prior4 Dec
- 2025CoD: A Diffusion Foundation Model for Image Compression24 Nov
- 2025Turbo-DDCM: Fast and Flexible Zero-Shot Diffusion-Based Image Compression9 Nov
- 2025Compressed Image Generation with Denoising Diffusion Codebook Models3 Feb
- 2025Lossy Compression with Pretrained Diffusion Models16 Jan
- 2024Lossy Image Compression with Foundation Diffusion Models12 Apr
- 2023High-Fidelity Image Compression with Score-based Generative Models26 May
- 2022Lossy Image Compression with Conditional Diffusion Models14 Sep
- 2022Lossy Compression with Gaussian Diffusion17 Jun
Other references · 43
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
- 2020Denoising Diffusion Implicit Modelscited by 9,718
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,028
- 2022Scalable Diffusion Models with Transformerscited by 5,973
- 2022Generative Adversarial Networkscited by 5,614
- 2022Flow Matching for Generative Modelingcited by 5,542
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,130
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,607
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,237
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,023
31 more
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,610
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,550
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,395
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,218
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 979
- 2022DPM-Solver++: Fast Solver for Guided Sampling of Diffusion Probabilistic Modelscited by 931
- 2018Variational image compression with a scale hyperpriorcited by 929
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 917
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 800
- 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 715
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 658
- 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 586
- 2020High-Fidelity Generative Image Compressioncited by 335
- 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 329
- 2020CompressAI: a PyTorch library and evaluation platform for end-to-end compression researchcited by 276
- 2018Learning Blind Video Temporal Consistencycited by 249
- 2018Generative Adversarial Networks for Extreme Learned Image Compressioncited by 216
- 2019Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoffcited by 208
- 2021FVC: A New Framework towards Deep Video Compression in Feature Spacecited by 153
- 2024Neural Video Compression with Feature Modulationcited by 121
- 2021Temporal Context Mining for Learned Video Compressioncited by 115
- 2023Towards image compression with perfect realism at ultra-low bitratescited by 101
- 2019Video Compression With Rate-Distortion Autoencoderscited by 97
- 2025Towards Practical Real-Time Neural Video Compressioncited by 78
- 2025Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcingcited by 38
- 2021Neural Video Compression using GANs for Detail Synthesis and Propagationcited by 36
- 2025Generative Latent Coding for Ultra-Low Bitrate Image and Video Compressioncited by 24
- 2025Generative Video Compression: Towards 0.01% Compression Rate for Video Transmissioncited by 11
- 2025Generative Latent Video Compressioncited by 10
- 2026Free-GVC: Towards Training-Free Extreme Generative Video Compression with Temporal Coherencecited by 10
- 2025Noise is All You Need: Solving Linear Inverse Problems by Noise Combination Sampling with Diffusion Modelscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026ZeroGVC: Zero-Shot Generative Video Compression with Autoregressive Diffusion Priorscited by 2
- 2026Generative Video Compression with Adaptive Score Distillationcited by 1
- 2026GVCCTurbo: Rate-Compute Quality Scheduling for Codebook Driven Generative Compressioncited by 0
- 2026A Spatiotemporal Semantic Importance-Guided Unified Compression and Editing Framework for AI-Generated Videoscited by 0
- 2026A Spatiotemporal Semantic Importance-Guided Unified Compression and Editing Framework for AI-Generated Videos5 Oct 2026
- 2026GVCCTurbo: Rate-Compute Quality Scheduling for Codebook Driven Generative Compression4 Aug 2026
- 2026Generative Video Compression with Adaptive Score Distillation24 Jul 2026
- 2026ZeroGVC: Zero-Shot Generative Video Compression with Autoregressive Diffusion Priors21 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026ReGenVC: End-to-End Real-Time Generative Video Coding at Ultra-Low Bitrate
- 2026GVC-RT: Towards Real-Time Generative Video Compression at Ultra-Low Bitrates
- 2026Gen2-VC: Unlocking Generative Priors for Video Compression ↗
- 2025T-GVC: Trajectory-Guided Generative Video Coding at Ultra-Low Bitrates
- 2026VoRTeC: Taming Foundation Flow for One-step Real time Video Compression
- 2026ProGVC: Progressive-based Generative Video Compression via Auto-Regressive Context Modeling
- 2026Active Sampling for Ultra-Low-Bit-Rate Video Compression via Conditional Controlled Diffusion
- 2026Rethinking Generative Image Compression at Extremely Low Bitrates