Active Intelligence in Video Avatars via Closed-loop World Modeling
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Current video avatar generation methods excel at identity preservation and motion alignment but lack genuine agency, they cannot autonomously pursue long-term goals through adaptive environmental interaction. We address this by introducing L-IVA (Long-horizon Interactive Visual Avatar), a task and benchmark for evaluating goal-directed planning in stochastic generative environments, and ORCA (Online Reasoning and Cognitive Architecture), the first framework enabling active intelligence in video avatars. ORCA embodies Internal World Model (IWM) capabilities through two key innovations: (1) a closed-loop OTAR cycle (Observe-Think-Act-Reflect) that maintains robust state tracking under generative uncertainty by continuously verifying predicted outcomes against actual generations, and (2) a hierarchical dual-system architecture where System 2 performs strategic reasoning with state prediction while System 1 translates abstract plans into precise, model-specific action captions. By formulating avatar control as a POMDP and implementing continuous belief updating with outcome verification, ORCA enables autonomous multi-step task completion in open-domain scenarios. Extensive experiments demonstrate that ORCA significantly outperforms open-loop and non-reflective baselines in task success rate and behavioral coherence, validating our IWM-inspired design for advancing video avatar intelligence from passive animation to active, goal-oriented behavior.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 25 of its 32 references that are in the map. First posted on arXiv 23 Dec 2025.
Builds on
25 of 32 references.
References · 25
- 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
- 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
- 2024ID-Animator: Zero-Shot Identity-Preserving Human Video Generationcited by 122
- 2025Controllable Video Generation: A Surveycited by 93
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 85
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
- 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 60
- 2025VAGEN: Reinforcing World Model Reasoning for Multi-Turn VLM Agentscited by 60
13 more
- 2024ConsistentID: Portrait Generation with Multimodal Fine-Grained Identity Preservingcited by 42
- 2025InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbingcited by 40
- 2025JarvisArt: Liberating Human Artistic Creativity via an Intelligent Photo Retouching Agentcited by 39
- 2025OmniHuman-1.5: Instilling an Active Mind in Avatars via Cognitive Simulationcited by 30
- 2025JarvisEvo: Towards a Self-Evolving Photo Editing Agent with Synergistic Editor-Evaluator Optimizationcited by 30
- 2025Concat-ID: Towards Universal Identity-Preserving Video Synthesiscited by 28
- 2025Why Do LLM Agents Fail in Exploring New Environments? A World-Modeling Perspectivecited by 28
- 2025VISTA: A Test-Time Self-Improving Video Generation Agentcited by 26
- 2025Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluationcited by 23
- 2025InterActHuman: Multi-Concept Human Animation with Layout-Aligned Audio Conditionscited by 20
- 2024GenMAC: Compositional Text-to-Video Generation with Multi-Agent Collaborationcited by 15
- 2025SayAnything: Audio-Driven Lip Synchronization with Conditional Video Diffusioncited by 12
- 2025DynamicFace: High-Quality and Consistent Face Swapping for Image and Video using Composable 3D Facial Priorscited by 10
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap
- 2026Autonomous Video Generation with Counterfactual Controllability for Self-Evolving World Models
- 2026Dreaming when Necessary: Advancing World Action Models with Adaptive Multi-Modal Reasoning
- 2023AgentAvatar: Disentangling Planning, Driving and Rendering for Photorealistic Avatar Agents
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning
- 2024EVA: An Embodied World Model for Future Video Anticipation
- 2025AVATAR: Reinforcement Learning to See, Hear, and Reason Over Video
- 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control