mlsanityData to 14 Oct 2026

Anchored Video Generation: Decoupling Scene Construction and Temporal Synthesis in Text-to-Video Diffusion Models

arXiv 2512.16371 ↗First posted 18 Dec 2025cs.CVcited by 1

On the map: Diffusion models → Video generation

Abstract (arXiv)

State-of-the-art Text-to-Video (T2V) diffusion models can generate visually impressive results, yet they still frequently fail to compose complex scenes or follow logical temporal instructions. In this paper, we argue that many errors, including apparent motion failures, originate from the model's inability to construct a semantically correct or logically consistent initial frame. We introduce Anchored Video Generation (AVG), a modular pipeline that decouples these tasks by decomposing the Text-to-Video generation into three specialized stages: (1) Reasoning, where a Large Language Model (LLM) rewrites the video prompt to describe only the initial scene, resolving temporal ambiguities; (2) Composition, where a Text-to-Image (T2I) model synthesizes a high-quality, compositionally-correct anchor frame from this new prompt; and (3) Temporal Synthesis, where a video model, finetuned to understand this anchor, focuses its entire capacity on animating the scene and following the prompt. Our approach sets a new state-of-the-art on the T2V CompBench benchmark and significantly improves all tested models on VBench2. Furthermore, we show that visual anchoring allows us to cut the number of sampling steps by 70% without any loss in performance. AVG offers a simple yet practical path toward more efficient, robust, and controllable video synthesis.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 41 of its 49 references that are in the map. First posted on arXiv 18 Dec 2025.

Builds on

41 of 49 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recycling10 Oct
  2. 2024Self-Correcting Text-to-Video Generation with Misalignment Detection and Localized Refinement22 Nov
  3. 2024Redefining Temporal Modeling in Video Diffusion: The Vectorized Timestep Approach4 Oct
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  5. 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attention29 Jul
  6. 2024VideoTetris: Towards Compositional Text-to-Video Generation6 Jun
  7. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation2 May
  8. 2024TI2V-Zero: Zero-Shot Image Conditioning for Text-to-Video Diffusion Models25 Apr
  9. 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
  10. 2024Latte: Latent Diffusion Transformer for Video Generation5 Jan
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  12. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generation30 Oct
1 more
  1. 2022Video Diffusion Models7 Apr

Other references · 28

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2022Flow Matching for Generative Modelingcited by 5,702
  4. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  9. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  10. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
  11. 2025Qwen-Image Technical Reportcited by 1,044
  12. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
16 more
  1. 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
  2. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  3. 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
  4. 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
  5. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
  6. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  7. 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 296
  8. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
  9. 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
  10. 2024Diffusion Model-Based Image Editing: A Surveycited by 212
  11. 2024T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generationcited by 185
  12. 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
  13. 2025LongCat-Video Technical Reportcited by 85
  14. 2025UltraVideo: High-Quality UHD Video Dataset with Comprehensive Captionscited by 57
  15. 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 30
  16. 2025CoMo: Compositional Motion Customization for Text-to-Video Generationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Searching Priors Makes Text-to-Video Synthesis Better
  2. 2026Image-to-Video Diffusion: From Foundations to Open Frontiers
  3. 2024Animate Your Motion: Turning Still Images into Dynamic Videos
  4. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generators
  5. 2023FusionFrames: Efficient Architectural Aspects for Text-to-Video Generation Pipeline
  6. 2024I4VGen: Image as Free Stepping Stone for Text-to-Video Generation
  7. 2025Plan-X: Instruct Video Generation via Semantic Planning
  8. 2025UI2V-Bench: An Understanding-based Image-to-video Generation Benchmark