SPIRAL: Self-Evolving Action-Conditioned Video Generation via Reflective Planning Agents
Not on the map. Why?
Abstract (arXiv)
Long-horizon action-conditioned video generation aims to synthesize temporally coherent videos that follow complex action instructions over extended horizons, requiring procedural ordering, persistent action execution, and scene consistency beyond conventional TI2V's short-term fidelity. Existing single-shot video generation models typically operate in an open-loop manner, leading to incomplete action execution, hallucinated motions, and temporal drift. To address this, we propose SPIRAL, a closed-loop framework that performs sequential planning and iterative reflection for action-conditioned long-horizon video generation. Specifically, SPIRAL instantiates a think-act-reflect process: a PlanAgent decomposes high-level goals into sub-actions, which condition a VideoGenerator to synthesize each segment alongside a memory context, while a CriticAgent evaluates intermediate video segments to provide corrective feedback for iterative refinement. This closed-loop design further supports self-evolution by utilizing PlanAgent-proposed actions and CriticAgent-derived rewards for GRPO-based post-training to enhance the video generator's long-horizon consistency. Moreover, we introduce ActVideoGen-Dataset for task-specific training, and establish ActVideoGen-Bench as a dedicated evaluation suite for measuring action quality and temporal coherence. Experiments across multiple TI2V backbones alongside the self-evolving strategy show consistent gains on ActVideoGen-Bench and VBench, demonstrating the effectiveness of SPIRAL.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 70 of its 83 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
70 of 83 references.
References · 70
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2018World Modelscited by 1,444
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
38 more
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 489
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2025Absolute Zero: Reinforced Self-play Reasoning with Zero Datacited by 323
- 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 316
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
- 2025Improving Video Generation with Human Feedbackcited by 267
- 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Textcited by 242
- 2025LongLive: Real-time Interactive Long Video Generationcited by 237
- 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
- 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 194
- 2024VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generationcited by 190
- 2023Making LLaMA SEE and Draw with SEED Tokenizercited by 184
- 2024Motion Prompting: Controlling Video Generation with Motion Trajectoriescited by 176
- 2025Open-Sora 2.0: Training a Commercial-Level Video Generation Model in 200kcited by 157
- 2024VisionReward: Fine-Grained Multi-Dimensional Human Preference Learning for Image and Video Generationcited by 148
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2025Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Stepcited by 130
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 129
- 2025EvolveR: Self-Evolving LLM Agents through an Experience-Driven Lifecyclecited by 129
- 2025Video World Models with Long-term Spatial Memorycited by 124
- 2025SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformercited by 91
- 2025Stable Video Infinity: Infinite-Length Video Generation with Error Recyclingcited by 68
- 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planningcited by 66
- 20253D and 4D World Modeling: A Surveycited by 64
- 2025Hunyuan-GameCraft-2: Instruction-following Interactive Game World Modelcited by 58
- 2025DeepVideo-R1: Video Reinforcement Fine-Tuning via Difficulty-aware Regressive GRPOcited by 57
- 2025Video-Bench: Human-Aligned Video Generation Benchmarkcited by 53
- 2025From Reflection to Perfection: Scaling Inference-Time Optimization for Text-to-Image Diffusion Models via Reflection Tuningcited by 53
- 2024LiFT: Leveraging Human Feedback for Text-to-Video Model Alignmentcited by 51
- 2025GRPO-CARE: Consistency-Aware Reinforcement Learning for Multimodal Reasoningcited by 46
- 2025World-in-World: World Models in a Closed-Loop Worldcited by 44
- 2025WonderPlay: Dynamic 3D Scene Generation from a Single Image and Actionscited by 43
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistencycited by 6
- 2026Quo Vadis, World Modeling?cited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026Don't Read the Log: Execution Traces Contaminate Verifiers in Video-Generation Agentscited by 0
- 2026WorldGuide: Goal-Directed Video World Model for Procedural Task Executioncited by 0
- 2026WorldGuide: Goal-Directed Video World Model for Procedural Task Execution8 Oct 2026
- 2026Don't Read the Log: Execution Traces Contaminate Verifiers in Video-Generation Agents23 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026Quo Vadis, World Modeling?3 Aug 2026
- 2026A2RD: Agentic Autoregressive Diffusion for Long Video Consistency7 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026NEWTON: Agentic Planning for Physically Grounded Video Generation
- 2024VideoAgent: Self-Improving Video Generation
- 2025Infinity-RoPE: Action-Controllable Infinite Video Generation Emerges From Autoregressive Self-Rollout
- 2026VideoGen-Agent: Reinforcing Video Generation Agents
- 2026MVAgent: Multi-Agent Video Generation via Consistent Condition Construction and Shot-Level Policy Optimization
- 2025Image Generation as a Visual Planner for Robotic Manipulation
- 2026Grounding Generated Videos in Feasible Plans via World Models
- 2026VideoWeaver: Evaluating and Evolving Skills for Agentic Long Video Generation