mlsanityData to 14 Oct 2026

A Spatiotemporal Semantic Importance-Guided Unified Compression and Editing Framework for AI-Generated Videos

arXiv 2610.05779 ↗First posted 5 Oct 2026cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

AI-generated videos are rapidly increasing in volume, duration, and resolution, creating growing demands for efficient storage and transmission. Unlike natural videos captured from the physical world, AI-generated videos are samples from a learned generative distribution, where semantic structures are critical to content consistency, while many local textures and stochastic details can be plausibly regenerated. This distinction suggests that compression should preserve semantically important spatiotemporal information rather than reconstruct every pixel of a particular generative sample. Beyond reconstruction, AI-generated videos also create a practical need for prompt-based editing, where users expect to modify generated content while preserving its original spatiotemporal semantics. Motivated by these observations, we propose a unified compression and editing framework for AI-generated videos that incorporates a frozen video generator as a reusable generative prior. Within this framework, we design three spatiotemporal semantic importance-guided techniques that respectively address what to transmit, how much to transmit, and how to use the transmitted side information. First, an innovation selection method projects the latent discrepancy using spatiotemporal semantic importance, so that the selected innovations prioritize semantic invariants over replaceable generative variations. Second, a frame-adaptive bit allocation method estimates the nonuniform semantic demands of latent frames and allocates more innovations to frames requiring stronger semantic preservation. Third, a unified reconstruction and editing method continuously adjusts the influence of the transmitted side information, enabling the same compressed representation to provide strong guidance for faithful reconstruction or serve as a flexible semantic anchor for structure-preserving prompt-driven editing.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 56 of its 68 references that are in the map. First posted on arXiv 5 Oct 2026.

Builds on

56 of 68 references.

References · 56

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2022Generative Adversarial Networkscited by 5,627
  6. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  9. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  10. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  11. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  12. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
38 more
  1. 2025Video models are zero-shot learners and reasonerscited by 220
  2. 2023A Survey on Video Diffusion Modelscited by 206
  3. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
  4. 2023Neural Video Compression with Diverse Contextscited by 165
  5. 2026Seedance 2.0: Advancing Video Generation for World Complexitycited by 160
  6. 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 149
  7. 2024Neural Video Compression with Feature Modulationcited by 123
  8. 2023CCEdit: Creative and Controllable Video Editing via Diffusion Modelscited by 82
  9. 2025Towards Practical Real-Time Neural Video Compressioncited by 80
  10. 2025Kling-Omni Technical Reportcited by 71
  11. 2021Perceptual Learned Video Compression with Recurrent Conditional GANcited by 41
  12. 2021Neural Video Compression using GANs for Detail Synthesis and Propagationcited by 36
  13. 2023Towards Consistent Video Editing with Text-to-Image Diffusion Modelscited by 34
  14. 2025StableCodec: Taming One-Step Diffusion for Extreme Image Compressioncited by 33
  15. 2025StreamDiffusionV2: A Streaming System for Dynamic and Interactive Video Generationcited by 30
  16. 2025Compressed Image Generation with Denoising Diffusion Codebook Modelscited by 28
  17. 2024SnapGen-V: Generating a Five-Second Video within Five Seconds on a Mobile Devicecited by 27
  18. 2025Generative Latent Coding for Ultra-Low Bitrate Image and Video Compressioncited by 25
  19. 2025Diffusion-based Perceptual Neural Video Compression with Temporal Diffusion Information Reusecited by 22
  20. 2025Generative Neural Video Compression via Video Diffusion Priorcited by 18
  21. 2025On-device Sora: Enabling Training-Free Diffusion-based Text-to-Video Generation for Mobile Devicescited by 15
  22. 2021Learning Cross-Scale Weighted Prediction for Efficient Neural Video Compressioncited by 13
  23. 2025Single-step Diffusion-based Video Coding with Semantic-Temporal Guidancecited by 13
  24. 2025EasyV2V: A High-quality Instruction-based Video Editing Frameworkcited by 13
  25. 2025Neodragon: Mobile Video Generation using Diffusion Transformercited by 12
  26. 2026Free-GVC: Towards Training-Free Extreme Generative Video Compression with Temporal Coherencecited by 12
  27. 2025DiffVC-OSD: One-Step Diffusion-based Perceptual Neural Video Compression Frameworkcited by 11
  28. 2025Generative Latent Video Compressioncited by 11
  29. 2025GIViC: Generative Implicit Video Compressioncited by 10
  30. 2025T-GVC: Trajectory-Guided Generative Video Coding at Ultra-Low Bitratescited by 10
  31. 2026YODA: Yet Another One-step Diffusion-based Video Compressorcited by 9
  32. 2023High Visual-Fidelity Learned Video Compressioncited by 8
  33. 2025Turbo-DDCM: Fast and Flexible Zero-Shot Diffusion-Based Image Compressioncited by 8
  34. 2024Prediction and Reference Quality Adaptation for Learned Video Compressioncited by 5
  35. 2026EditCtrl: Disentangled Local and Global Control for Real-Time Generative Video Editingcited by 5
  36. 2026GVCC: Zero-Shot Video Compression via Codebook-Driven Stochastic Rectified Flowcited by 5
  37. 2025Low-Bitrate Video Compression through Semantic-Conditioned Diffusioncited by 4
  38. 2026Generative Video Compression with One-Dimensional Latent Representationcited by 4

50 most cited of 56 All 56 (JSON)

Built on by

Not cited yet.