mlsanityData to 14 Oct 2026

Astra: General Interactive World Model with Autoregressive Denoising

arXiv 2512.08931 ↗First posted 9 Dec 2025cs.CV cs.AI cs.LGcited by 33

On the map: World models → Video-generation world models and simulators

also in 1 more
Abstract (arXiv)

Recent advances in diffusion transformers have empowered video generation models to generate high-quality video clips from texts or images. However, world models with the ability to predict long-horizon futures from past observations and actions remain underexplored, especially for general-purpose scenarios and various forms of actions. To bridge this gap, we introduce Astra, an interactive general world model that generates real-world futures for diverse scenarios (e.g., autonomous driving, robot grasping) with precise action interactions (e.g., camera motion, robot action). We propose an autoregressive denoising architecture and use temporal causal attention to aggregate past observations and support streaming outputs. We use a noise-augmented history memory to avoid over-reliance on past frames to balance responsiveness with temporal coherence. For precise action control, we introduce an action-aware adapter that directly injects action signals into the denoising process. We further develop a mixture of action experts that dynamically route heterogeneous action modalities, enhancing versatility across diverse real-world tasks such as exploration, manipulation, and camera control. Astra achieves interactive, consistent, and general long-term video prediction and supports various forms of interactions. Experiments across multiple datasets demonstrate the improvements of Astra in fidelity, long-range prediction, and action alignment over existing state-of-the-art world models.

Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 36 of its 38 references that are in the map. First posted on arXiv 9 Dec 2025.

Builds on

36 of 38 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  2. 2025Yume: An Interactive World Generation Model23 Jul
  3. 2025Vid2World: Crafting Video Diffusion Models to Interactive World Models20 May
  4. 2025MAGI-1: Autoregressive Video Generation at Scale19 May
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  6. 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
  7. 2024WorldSimBench: Towards Video Generation Models as World Simulators23 Oct
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  9. 2024StreamingT2V: Consistent, Dynamic, and Extendable Long Video Generation from Text21 Mar
  10. 2024Genie: Generative Interactive Environments23 Feb
  11. 2024World Model on Million-Length Video And Language With Blockwise RingAttention13 Feb
  12. 2024WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens18 Jan
3 more
  1. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  2. 2022Scalable Diffusion Models with Transformers19 Dec
  3. 2020Denoising Diffusion Probabilistic Models19 Jun

Other references · 21

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2020Denoising Diffusion Implicit Modelscited by 9,781
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  6. 2022Video Diffusion Modelscited by 2,305
  7. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  9. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  10. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  11. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 546
  12. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
9 more
  1. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  2. 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
  3. 2024Navigation World Modelscited by 272
  4. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
  5. 2025History-Guided Video Diffusioncited by 171
  6. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 146
  7. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
  8. 2025Sekai: A Video Dataset towards World Explorationcited by 67
  9. 2024CityWalker: Learning Embodied Urban Navigation from Web-Scale Videoscited by 41

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 33.

33 papers.

Sort:

By area:

  1. 2026Helios: Real Real-Time Long Video Generation Modelcited by 65
  2. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 55
  3. 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RLcited by 50
  4. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluationcited by 39
  5. 2026One-Forcing: Towards Stable One-Step Autoregressive Video Generationcited by 15
  6. 2026iWorld-Bench: A Benchmark for Interactive World Models with a Unified Action Generation Frameworkcited by 14
  7. 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memorycited by 14
  8. 2026Grounding World Simulation Models in a Real-World Metropoliscited by 12
  9. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trendscited by 8
  10. 2026Directing the World: Fast Autoregressive Video Generation with Compositional Human-Camera Controlcited by 6
  11. 2026Motion Attribution for Video Generationcited by 5
  12. 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
21 more
  1. 2026Human Cognition in Machines: A Unified Perspective of World Modelscited by 5
  2. 2026Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Controlcited by 5
  3. 2026PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectivescited by 5
  4. 2026From Pixels to States: Rethinking Interactive World Models as Game Enginescited by 4
  5. 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivitycited by 4
  6. 2026Research on World Models Is Not Merely Injecting World Knowledge into Specific Taskscited by 3
  7. 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 3
  8. 2026AnchorWorld: Embodied Egocentric World Simulation with View-based Evolution Customizationcited by 3
  9. 2026DisCo: World Models with Discrete Camera Motion Controlcited by 2
  10. 2026PhiZero: A World Model Built Around Physical Languagecited by 2
  11. 2026Uncertainty-Aware World Model for Aerial Image-Goal Navigationcited by 2
  12. 2026HelloWorld: Enabling Socially Interactive Characters in Video World Modelscited by 1
  13. 2026Precise Editing and Flexible Referencing for Interactable Worldscited by 1
  14. 2026Puffin-World: Scaling a Unified Multimodal Model with Native 3D World Statescited by 0
  15. 2026Action Forcing: Training World Models on Unsupervised Video by Recovering Underlying Egomotion Basescited by 0
  16. 2026Geometry as Address: Routing Attention to Visual Memory for Long-Horizon Camera-Controlled Video Generationcited by 0
  17. 2026BadAction: Backdoor Attacks on Interactive Video Generation via Action-Guided Triggerscited by 0
  18. 2026World Observer: Joint Actor-Observer Generation for Persistent World Modelingcited by 0
  19. 2026ProAR: Learning Prospective Reasoning with Autoregressive Video Modelscited by 0
  20. 2026HLA-WM: Hybrid Linear Attention for Long-Horizon Video World Modelscited by 0
  21. 2026LongForcing: Scaling Temporal Manifold Matching for Long-Horizon World Rolloutcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024AVID: Adapting Video Diffusion Models to World Models
  2. 2026Unified 4D World Action Modeling from Video Priors with Asynchronous Denoising
  3. 2026C3ache: Accelerating World Action Models with Cross Inference Chunk Cache
  4. 2025LongScape: Advancing Long-Horizon Embodied World Models with Context-Aware MoE
  5. 2024Prediction with Action: Visual Policy Learning via Joint Denoising Process
  6. 2026NoiseGate: Learning Per-Latent Timestep Schedules as Information Gating in World Action Models
  7. 2026CtrlCache: Accelerating Interactive Video World Models with Control-Aware Caching
  8. 2026Foresight Without Seeing: Latent Futures for World Action Models