Astra: General Interactive World Model with Autoregressive Denoising
On the map: World models → Video-generation world models and simulators
also in 1 more
Abstract (arXiv)
Recent advances in diffusion transformers have empowered video generation models to generate high-quality video clips from texts or images. However, world models with the ability to predict long-horizon futures from past observations and actions remain underexplored, especially for general-purpose scenarios and various forms of actions. To bridge this gap, we introduce Astra, an interactive general world model that generates real-world futures for diverse scenarios (e.g., autonomous driving, robot grasping) with precise action interactions (e.g., camera motion, robot action). We propose an autoregressive denoising architecture and use temporal causal attention to aggregate past observations and support streaming outputs. We use a noise-augmented history memory to avoid over-reliance on past frames to balance responsiveness with temporal coherence. For precise action control, we introduce an action-aware adapter that directly injects action signals into the denoising process. We further develop a mixture of action experts that dynamically route heterogeneous action modalities, enhancing versatility across diverse real-world tasks such as exploration, manipulation, and camera control. Astra achieves interactive, consistent, and general long-term video prediction and supports various forms of interactions. Experiments across multiple datasets demonstrate the improvements of Astra in fidelity, long-range prediction, and action alignment over existing state-of-the-art world models.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 36 of its 38 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
36 of 38 references.
Closest ancestors · 15
Same direction, newest first
- 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
- 2025Yume: An Interactive World Generation Model23 Jul
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Models20 May
- 2025MAGI-1: Autoregressive Video Generation at Scale19 May
- 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
- 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
- 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
- 2024Genie: Generative Interactive Environments23 Feb
- 2024World Model on Million-Length Video And Language With Blockwise RingAttention13 Feb
- 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens18 Jan
3 more
Other references · 21
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022Video Diffusion Modelscited by 2,305
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
9 more
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2024Navigation World Modelscited by 272
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
- 2025History-Guided Video Diffusioncited by 171
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 146
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
- 2025Sekai: A Video Dataset towards World Explorationcited by 67
- 2024CityWalker: Learning Embodied Urban Navigation from Web-Scale Videoscited by 41
Built on by
Citing papers per year: 2026: 33.
33 papers.
Sort:
By area:
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 55
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 50
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 39
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generationcited by 15
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Frameworkcited by 14
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 14
- 2026Grounding World Simulation Models in a Real-World Metropoliscited by 12
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
- 2026Motion Attribution for Video Generationcited by 5
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
21 more
- 2026Human Cognition in Machines: A Unified Perspective of World Modelscited by 5
- 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Controlcited by 5
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectivescited by 5
- 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 4
- 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Taskscited by 3
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 3
- 2026AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customizationcited by 3
- 2026DisCo: World Models with Discrete Camera Motion Controlcited by 2
- 2026PhiZero: A World Model Built Around Physical Languagecited by 2
- 2026Uncertainty-Aware World Model for Aerial Image-Goal Navigationcited by 2
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Modelscited by 1
- 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World Statescited by 0
- 2026Action Forcing: Training World Models on Unsupervised Video by Recovering Underlying Egomotion Basescited by 0
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generationcited by 0
- 2026BadAction: Backdoor Attacks on Interactive Video Generation via Action-Guided Triggerscited by 0
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modelingcited by 0
- 2026ProAR: Learning Prospective Reasoning with Autoregressive Video Modelscited by 0
- 2026HLA-WM: Hybrid Linear Attention for Long-Horizon Video World Modelscited by 0
- 2026LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rolloutcited by 0
- 2026LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rollout13 Oct 2026
- 2026HLA-WM: Hybrid Linear Attention for Long-Horizon Video World Models5 Oct 2026
- 2026ProAR: Learning Prospective Reasoning with Autoregressive Video Models2 Oct 2026
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modeling1 Oct 2026
- 2026BadAction: Backdoor Attacks on Interactive Video Generation via Action-Guided Triggers30 Sep 2026
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generation28 Sep 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026Action Forcing: Training World Models on Unsupervised Video by Recovering Underlying Egomotion Bases24 Sep 2026
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States3 Sep 2026
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives13 Aug 2026
- 2026Uncertainty-Aware World Model for Aerial Image-Goal Navigation6 Aug 2026
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Models5 Aug 2026
21 more
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
- 2026PhiZero: A World Model Built Around Physical Language30 Jul 2026
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul 2026
- 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control4 Jul 2026
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Control26 Jun 2026
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory16 Jun 2026
- 2026DisCo: World Models with Discrete Camera Motion Control6 Jun 2026
- 2026AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customization5 Jun 2026
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends31 May 2026
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May 2026
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generation22 May 2026
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling14 May 2026
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May 2026
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Framework5 May 2026
- 2026Human Cognition in Machines: A Unified Perspective of World Models17 Apr 2026
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithms30 Mar 2026
- 2026Grounding World Simulation Models in a Real-World Metropolis16 Mar 2026
- 2026Helios: Real Real-Time Long Video Generation Model4 Mar 2026
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL15 Feb 2026
- 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Tasks2 Feb 2026
- 2026Motion Attribution for Video Generation13 Jan 2026
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 55
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 50
- 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 39
- 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Frameworkcited by 14
- 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 14
- 2026Grounding World Simulation Models in a Real-World Metropoliscited by 12
- 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
- 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
- 2026Human Cognition in Machines: A Unified Perspective of World Modelscited by 5
- 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Controlcited by 5
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectivescited by 5
12 most cited of 26 All 26 (JSON)
- 2026LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rollout13 Oct 2026
- 2026HLA-WM: Hybrid Linear Attention for Long-Horizon Video World Models5 Oct 2026
- 2026World Observer: Joint Actor-Observer Generation for Persistent World Modeling1 Oct 2026
- 2026Precise Editing and Flexible Referencing for Interactable Worlds28 Sep 2026
- 2026Action Forcing: Training World Models on Unsupervised Video by Recovering Underlying Egomotion Bases24 Sep 2026
- 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives13 Aug 2026
- 2026Uncertainty-Aware World Model for Aerial Image-Goal Navigation6 Aug 2026
- 2026HelloWorld: Enabling Socially Interactive Characters in Video World Models5 Aug 2026
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity3 Aug 2026
- 2026PhiZero: A World Model Built Around Physical Language30 Jul 2026
- 2026From Pixels to States: Rethinking Interactive World Models as Game Engines15 Jul 2026
- 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control4 Jul 2026
12 newest of 26 All 26 (JSON)
- 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generationcited by 15
- 2026Motion Attribution for Video Generationcited by 5
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World Statescited by 0
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generationcited by 0
- 2026ProAR: Learning Prospective Reasoning with Autoregressive Video Modelscited by 0
- 2026ProAR: Learning Prospective Reasoning with Autoregressive Video Models2 Oct 2026
- 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generation28 Sep 2026
- 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States3 Sep 2026
- 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generation22 May 2026
- 2026Helios: Real Real-Time Long Video Generation Model4 Mar 2026
- 2026Motion Attribution for Video Generation13 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024AVID: Adapting Video Diffusion Models to World Models
- 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising
- 2026C3ache: Accelerating World Action Models with Cross Inference Chunk Cache
- 2025LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoE
- 2024Prediction with Action: Visual Policy Learning via Joint Denoising Process
- 2026NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models
- 2026CtrlCache: Accelerating Interactive Video World Models with Control-Aware Caching
- 2026Foresight Without Seeing: Latent Futures for World Action Models