mlsanityData to 14 Oct 2026

EchoWM: Open and Enterable Omnimodal World Models

arXiv 2608.23189 ↗First posted 24 Aug 2026cs.CVcited by 13

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

We present EchoWM, an omnimodal world model for enterable generative media that responds to continuous navigation while jointly generating 720p video, environmental sound, music and speech. We organize interaction around camera intent: in first-person scenes, it specifies observer motion, while in third-person scenes, camera--character dynamics are learned from data without view-specific controllers. Discrete commands and continuous poses are mapped to a shared metric-scale relative 6-DoF trajectory, with dataset-level calibration preserving motion magnitude across heterogeneous data. To jointly learn audio-visual generation and trajectory control, we construct a complementary data engine and adopt progressive training followed by autoregressive post-training for long-horizon generation. Extensive evaluations show that model achieves strong trajectory following and high visual quality on public world-model benchmarks, supporting both first- and third-person interaction across varied subjects, and maintaining synchronized environmental sound and speech over long-horizon generation.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 49 of its 52 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

49 of 52 references.

Closest ancestors · 17

Same direction, newest first

  1. 2026Alaya-EVOKE: From Linear-Scaling Supervision to Endless World13 Aug
  2. 2026ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU21 Jul
  3. 2026DreamX-World 1.0: A General-Purpose Interactive World Model15 Jun
  4. 2026Cosmos 3: Omnimodal World Models for Physical AI1 Jun
  5. 2026WBench: A Comprehensive Multi-turn Benchmark for Interactive Video World Model Evaluation25 May
  6. 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May
  7. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory10 Apr
  8. 2026Solaris: Building a Multiplayer Video World Model in Minecraft25 Feb
  9. 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
  10. 2026Advancing Open-source World Models28 Jan
  11. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling16 Dec
  12. 2025Unified Camera Positional Encoding for Controlled Video Generation8 Dec
5 more
  1. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  2. 2025Yume: An Interactive World Generation Model23 Jul
  3. 2025WorldMem: Long-term Consistent World Simulation with Memory16 Apr
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  5. 2024Genie: Generative Interactive Environments23 Feb

Other references · 32

  1. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  2. 2018World Modelscited by 1,513
  3. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  4. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  5. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  6. 2024Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusioncited by 681
  7. 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
  8. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  9. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  10. 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
  11. 2025Qwen3-Omni Technical Reportcited by 497
  12. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
20 more
  1. 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
  2. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
  3. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Drivingcited by 261
  4. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 259
  5. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
  6. 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 195
  7. 2025ViPE: Video Pose Engine for 3D Geometric Perceptioncited by 170
  8. 2024CamCo: Camera-Controllable 3D-Consistent Image-to-Video Generationcited by 166
  9. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 163
  10. 2025HunyuanVideo 1.5 Technical Reportcited by 160
  11. 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 143
  12. 2023Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Modelscited by 134
  13. 2024MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesiscited by 134
  14. 2024FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Soundscited by 110
  15. 2025Hunyuan-GameCraft: High-dynamic Interactive Game Video Generation with Hybrid History Conditioncited by 98
  16. 2026Lyra 2.0: Explorable Generative 3D Worldscited by 44
  17. 2024SyncFlow: Toward Temporally Aligned Joint Audio-Video Generation from Textcited by 26
  18. 2026Self Gradient Forcing: Native Long Video Extrapolationcited by 17
  19. 2026OmniForcing: Unleashing Real-time Joint Audio-Visual Generationcited by 16
  20. 2026Video = World + Event Streamcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds
  2. 2025Audio-Visual World Models: Learning Physically Grounded Multisensory Dynamics
  3. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Models
  4. 2026Can MiniMax-H3 Reason About the Physical World? An Evaluation of Omni-Modal Generative Model
  5. 2025OmniCam: Unified Multimodal Video Generation via Camera Control
  6. 2026Vorch-Omni: Multi-Task Orchestration of Sight and Sound
  7. 2026Archon: A Unified Multimodal Model for Holistic Digital Human Generation
  8. 2026Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models