Golden Anchor for Video Generation
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Video generation supports digital content creation, with applications in virtual avatars, AI-driven filmmaking, interactive game engines, and world models. State-of-the-art systems achieve controllability primarily through image-to-video (I2V) generation, in which an injected anchor image determines the identity, composition, and style of the resulting video. In modern pipelines, this anchor is synthesized by a text-to-image (T2I) generator. This raises a largely overlooked question: Are images obtained directly from the T2I model truly suitable for current video models? Our analysis shows that anchor aesthetic and quality scores are weakly correlated with downstream video quality. The structure-and-texture score is negatively correlated with I2V video quality in both the visual and motion dimensions. Fine-tuning the T2I model on an image reward accordingly yields anchors with visibly denser structural and character detail: they score higher on image metrics, yet lower the video reward on every I2V model we test and change downstream motion unpredictably. We therefore introduce Golden Anchor Learning (GAL), to our knowledge the first framework for learning golden anchors by optimizing a T2I generator with downstream video feedback. GAL evaluates candidate anchors through the videos they induce under a frozen I2V model and converts video rewards into image-level preferences for DPO fine-tuning of the T2I generator. On all four I2V models, GAL raises the VBench average by 2.97%--8.46% over the untuned generator. The rendered clips also score higher under VideoReward-Overall, and their extracted frames under HPSv3 and UniPercept. GAL yields consistent motion gains across all four I2V models, as measured by a 5.62%--38.24% increase in VBench dynamic degree. Although GAL is trained only on HunyuanVideo-1.5 renders, these gains extend to the other three I2V models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 64 of its 70 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
64 of 70 references.
Closest ancestors · 8
Same direction, newest first
- 2026MaineCoon: Pursuing A Real-Time Audio-Visual Social World Model16 Jun
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024Diffusion Models Are Real-Time Game Engines27 Aug
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Genie: Generative Interactive Environments23 Feb
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
- 2022Flow Matching for Generative Modeling6 Oct
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
Other references · 56
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023Consistency Modelscited by 1,822
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023Training Diffusion Models with Reinforcement Learningcited by 982
- 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
- 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
38 more
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 790
- 2023Adversarial Diffusion Distillationcited by 759
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
- 2025Improving Video Generation with Human Feedbackcited by 284
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
- 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 235
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 230
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 129
- 2024VideoDPO: Omni-Preference Alignment for Video Diffusion Generationcited by 108
- 2024Golden Noise for Diffusion Models: A Learning Frameworkcited by 92
- 2025Automated Movie Generation via Multi-Agent CoT Planningcited by 89
- 2025Decoupled DMD: CFG Augmentation as the Spear, Distribution Matching as the Shieldcited by 45
- 2024Zigzag Diffusion Sampling: Diffusion Models Can Self-Improve via Self-Reflectioncited by 41
- 2024Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generationcited by 37
- 2024Alignment of Diffusion Models: Fundamentals, Challenges, and Futurecited by 35
- 2025DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Modelscited by 34
- 2025VPO: Aligning Text-to-Video Generation Models with Prompt Optimizationcited by 30
- 2024Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Modelcited by 28
- 2025Affordance-R1: Reinforcement Learning for Generalizable Affordance Reasoning in Multimodal Large Language Modelcited by 23
- 2025UniPercept: Towards Unified Perceptual-Level Image Understanding across Aesthetics, Quality, Structure, and Texturecited by 22
- 2025MAViS: A Multi-Agent Framework for Long-Sequence Video Storytellingcited by 21
- 2025Hierarchical Fine-grained Preference Optimization for Physically Plausible Video Generationcited by 21
- 2025MagicDistillation: Weak-to-Strong Video Distillation for Large-Scale Few-Step Synthesiscited by 19
- 2025AniMaker: Multi-Agent Animated Storytelling with MCTS-Driven Clip Generationcited by 19
- 2024I4VGen: Image as Free Stepping Stone for Text-to-Video Generationcited by 14
- 2024DiffLoRA: Generating Personalized Low-Rank Adaptation Weights with Diffusioncited by 12
- 2025First Frame Is the Place to Go for Video Content Customizationcited by 12
- 2026Optimizing Few-Step Generation with Adaptive Matching Distillationcited by 11
- 2024IV-Mixed Sampler: Leveraging Image Diffusion Models for Enhanced Video Synthesiscited by 10
- 2025Improving Motion in Image-to-Video Models via Adaptive Low-Pass Guidancecited by 6
50 most cited of 56 All 56 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Anchored Video Generation: Decoupling Scene Construction and Temporal Synthesis in Text-to-Video Diffusion Models
- 2026Transforming Image Editors into Video Editors
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
- 2026UniVid: Pyramid Diffusion Model for High Quality Video Generation
- 2026VGA-BenchV2: An Expanded Unified Benchmark and Multi-Model Framework for Evaluating Video Aesthetics and Generation Quality
- 2025VideoScore2: Think before You Score in Generative Video Evaluation
- 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generation
- 2024VideoElevator: Elevating Video Generation Quality with Versatile Text-to-Image Diffusion Models