mlsanityData to 14 Oct 2026

Golden Anchor for Video Generation

arXiv 2610.13217 ↗First posted 9 Oct 2026cs.CV cs.LGcited by 0

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Video generation supports digital content creation, with applications in virtual avatars, AI-driven filmmaking, interactive game engines, and world models. State-of-the-art systems achieve controllability primarily through image-to-video (I2V) generation, in which an injected anchor image determines the identity, composition, and style of the resulting video. In modern pipelines, this anchor is synthesized by a text-to-image (T2I) generator. This raises a largely overlooked question: Are images obtained directly from the T2I model truly suitable for current video models? Our analysis shows that anchor aesthetic and quality scores are weakly correlated with downstream video quality. The structure-and-texture score is negatively correlated with I2V video quality in both the visual and motion dimensions. Fine-tuning the T2I model on an image reward accordingly yields anchors with visibly denser structural and character detail: they score higher on image metrics, yet lower the video reward on every I2V model we test and change downstream motion unpredictably. We therefore introduce Golden Anchor Learning (GAL), to our knowledge the first framework for learning golden anchors by optimizing a T2I generator with downstream video feedback. GAL evaluates candidate anchors through the videos they induce under a frozen I2V model and converts video rewards into image-level preferences for DPO fine-tuning of the T2I generator. On all four I2V models, GAL raises the VBench average by 2.97%--8.46% over the untuned generator. The rendered clips also score higher under VideoReward-Overall, and their extracted frames under HPSv3 and UniPercept. GAL yields consistent motion gains across all four I2V models, as measured by a 5.62%--38.24% increase in VBench dynamic degree. Although GAL is trained only on HunyuanVideo-1.5 renders, these gains extend to the other three I2V models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 64 of its 70 references that are in the map. First posted on arXiv 9 Oct 2026.

Builds on

64 of 70 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026MaineCoon: Pursuing A Real-Time Audio-Visual Social World Model16 Jun
  2. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  3. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  4. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  5. 2024Genie: Generative Interactive Environments23 Feb
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  7. 2022Flow Matching for Generative Modeling6 Oct
  8. 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov

Other references · 56

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  3. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  6. 2023Consistency Modelscited by 1,822
  7. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  8. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  9. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  10. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
  11. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
  12. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
38 more
  1. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  2. 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
  3. 2023Adversarial Diffusion Distillationcited by 759
  4. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  5. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  6. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  7. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  8. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
  9. 2025Improving Video Generation with Human Feedbackcited by 284
  10. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
  11. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
  12. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 235
  13. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 230
  14. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
  15. 2025HunyuanVideo 1.5 Technical Reportcited by 160
  16. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 129
  17. 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generationcited by 108
  18. 2024Golden Noise for Diffusion Models: A Learning Frameworkcited by 92
  19. 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 89
  20. 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 45
  21. 2024Zigzag Diffusion Sampling: Diffusion Models Can Self-Improve via Self-Reflectioncited by 41
  22. 2024Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generationcited by 37
  23. 2024Alignment of Diffusion Models: Fundamentals, Challenges, and Futurecited by 35
  24. 2025DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Modelscited by 34
  25. 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 30
  26. 2024Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Modelcited by 28
  27. 2025Affordance-R1: Reinforcement Learning for Generalizable Affordance Reasoning in Multimodal Large Language Modelcited by 23
  28. 2025UniPercept: Towards Unified Perceptual-Level Image Understanding across Aesthetics, Quality, Structure, and Texturecited by 22
  29. 2025MAViS: A Multi-Agent Framework for Long-Sequence Video Storytellingcited by 21
  30. 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generationcited by 21
  31. 2025MagicDistillation: Weak-to-Strong Video Distillation for Large-Scale Few-Step Synthesiscited by 19
  32. 2025AniMaker: Multi-Agent Animated Storytelling with MCTS-Driven Clip Generationcited by 19
  33. 2024I4VGen: Image as Free Stepping Stone for Text-to-Video Generationcited by 14
  34. 2024DiffLoRA: Generating Personalized Low-Rank Adaptation Weights with Diffusioncited by 12
  35. 2025First Frame Is the Place to Go for Video Content Customizationcited by 12
  36. 2026Optimizing Few-Step Generation with Adaptive Matching Distillationcited by 11
  37. 2024IV-Mixed Sampler: Leveraging Image Diffusion Models for Enhanced Video Synthesiscited by 10
  38. 2025Improving Motion in Image-to-Video Models via Adaptive Low-Pass Guidancecited by 6

50 most cited of 56 All 56 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Anchored Video Generation: Decoupling Scene Construction and Temporal Synthesis in Text-to-Video Diffusion Models
  2. 2026Transforming Image Editors into Video Editors
  3. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
  4. 2026UniVid: Pyramid Diffusion Model for High Quality Video Generation
  5. 2026VGA-BenchV2: An Expanded Unified Benchmark and Multi-Model Framework for Evaluating Video Aesthetics and Generation Quality
  6. 2025VideoScore2: Think before You Score in Generative Video Evaluation
  7. 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generation
  8. 2024VideoElevator: Elevating Video Generation Quality with Versatile Text-to-Image Diffusion Models