A Spatiotemporal Semantic Importance-Guided Unified Compression and Editing Framework for AI-Generated Videos
Not on the map. Why?
Abstract (arXiv)
AI-generated videos are rapidly increasing in volume, duration, and resolution, creating growing demands for efficient storage and transmission. Unlike natural videos captured from the physical world, AI-generated videos are samples from a learned generative distribution, where semantic structures are critical to content consistency, while many local textures and stochastic details can be plausibly regenerated. This distinction suggests that compression should preserve semantically important spatiotemporal information rather than reconstruct every pixel of a particular generative sample. Beyond reconstruction, AI-generated videos also create a practical need for prompt-based editing, where users expect to modify generated content while preserving its original spatiotemporal semantics. Motivated by these observations, we propose a unified compression and editing framework for AI-generated videos that incorporates a frozen video generator as a reusable generative prior. Within this framework, we design three spatiotemporal semantic importance-guided techniques that respectively address what to transmit, how much to transmit, and how to use the transmitted side information. First, an innovation selection method projects the latent discrepancy using spatiotemporal semantic importance, so that the selected innovations prioritize semantic invariants over replaceable generative variations. Second, a frame-adaptive bit allocation method estimates the nonuniform semantic demands of latent frames and allocates more innovations to frames requiring stronger semantic preservation. Third, a unified reconstruction and editing method continuously adjusts the influence of the transmitted side information, enabling the same compressed representation to provide strong guidance for faithful reconstruction or serve as a flexible semantic anchor for structure-preserving prompt-driven editing.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 68 references that are in the map. First posted on arXiv 5 Oct 2026.
Builds on
56 of 68 references.
References · 56
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Generative Adversarial Networkscited by 5,627
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2023Pix2Video: Video Editing using Image Diffusioncited by 320
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
38 more
- 2025Video models are zero-shot learners and reasonerscited by 220
- 2023A Survey on Video Diffusion Modelscited by 206
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
- 2023Neural Video Compression with Diverse Contextscited by 165
- 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 149
- 2024Neural Video Compression with Feature Modulationcited by 123
- 2023CCEdit: Creative and Controllable Video Editing via Diffusion Modelscited by 82
- 2025Towards Practical Real-Time Neural Video Compressioncited by 80
- 2025Kling-Omni Technical Reportcited by 71
- 2021Perceptual Learned Video Compression with Recurrent Conditional GANcited by 41
- 2021Neural Video Compression using GANs for Detail Synthesis and Propagationcited by 36
- 2023Towards Consistent Video Editing with Text-to-Image Diffusion Modelscited by 34
- 2025StableCodec: Taming One-Step Diffusion for Extreme Image Compressioncited by 33
- 2025StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generationcited by 30
- 2025Compressed Image Generation with Denoising Diffusion Codebook Modelscited by 28
- 2024SnapGen-V: Generating a Five-Second Video within Five Seconds on a Mobile Devicecited by 27
- 2025Generative Latent Coding for Ultra-Low Bitrate Image and Video Compressioncited by 25
- 2025Diffusion-based Perceptual Neural Video Compression with Temporal Diffusion Information Reusecited by 22
- 2025Generative Neural Video Compression via Video Diffusion Priorcited by 18
- 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devicescited by 15
- 2021Learning Cross-Scale Weighted Prediction for Efficient Neural Video Compressioncited by 13
- 2025Single-step Diffusion-based Video Coding with Semantic-Temporal Guidancecited by 13
- 2025EasyV2V: A High-quality Instruction-based Video Editing Frameworkcited by 13
- 2025Neodragon: Mobile Video Generation using Diffusion Transformercited by 12
- 2026Free-GVC: Towards Training-Free Extreme Generative Video Compression with Temporal Coherencecited by 12
- 2025DiffVC-OSD: One-Step Diffusion-based Perceptual Neural Video Compression Frameworkcited by 11
- 2025Generative Latent Video Compressioncited by 11
- 2025GIViC: Generative Implicit Video Compressioncited by 10
- 2025T-GVC: Trajectory-Guided Generative Video Coding at Ultra-Low Bitratescited by 10
- 2026YODA: Yet Another One-step Diffusion-based Video Compressorcited by 9
- 2023High Visual-Fidelity Learned Video Compressioncited by 8
- 2025Turbo-DDCM: Fast and Flexible Zero-Shot Diffusion-Based Image Compressioncited by 8
- 2024Prediction and Reference Quality Adaptation for Learned Video Compressioncited by 5
- 2026EditCtrl: Disentangled Local and Global Control for Real-Time Generative Video Editingcited by 5
- 2026GVCC: Zero-Shot Video Compression via Codebook-Driven Stochastic Rectified Flowcited by 5
- 2025Low-Bitrate Video Compression through Semantic-Conditioned Diffusioncited by 4
- 2026Generative Video Compression with One-Dimensional Latent Representationcited by 4
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.