mlsanityData to 14 Oct 2026

R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models

arXiv 2608.27328 ↗First posted 27 Aug 2026cs.CVcited by 4

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

High similarity between first-visit and return frames does not necessarily show that a video world model remembered the scene; the intervening rollout may simply have changed very little. This ambiguity makes absolute revisit scores sensitive to rendering stability, repetitive content, and failed motion. We introduce R2M-Bench (Relative Revisit Memory Benchmark), a benchmark of observable revisit-selective consistency. For every detected return, R2M-Bench compares the revisit pair with two controls from the same rollout: a gap-matched non-revisit pair that measures generic temporal stability and a short-range pair that estimates short-horizon consistency. These comparisons produce MemoryGain (MG), the revisit advantage over the temporal baseline, and the Normalized Memory Ratio (NMR), which normalizes this advantage by the short-to-baseline dynamic range. R2M-Bench combines 100 reference scenes with three leave-and-return trajectories to form 300 instances and evaluates appearance fidelity, scene and object identity, local geometry, and persistent state. Across seven action-conditioned video world models, Overall NMR correlates with human consistency judgments at Spearman's ρ=0.547 (95% CI [0.45,0.63]). Its within-model correlation magnitude with generated motion is 0.072, compared with 0.207 for raw revisit similarity, indicating that relative calibration substantially reduces the slow-motion shortcut. DreamX-World-Memo achieves the highest Overall NMR among the evaluated video models. Together, these results support same-rollout relative calibration as a practical way to distinguish revisit-specific consistency from generic temporal stability.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 40 of its 47 references that are in the map. First posted on arXiv 27 Aug 2026.

Builds on

40 of 47 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026Compression and Retrieval: Implicit Memory Retrieval for Video World Models22 Jun
  2. 2026Latent Spatial Memory for Video World Models8 Jun
  3. 2026MBench: A Comprehensive Benchmark on Memory Capability for Video World Models30 May
  4. 2026Infinite-World: Scaling Interactive World Models to 1000-Frame Horizons via Pose-Free Hierarchical Memory2 Feb
  5. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
  6. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulness27 Mar
  7. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  8. 2024Open-Sora: Democratizing Efficient Video Production for All29 Dec
  9. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  10. 2024Genie: Generative Interactive Environments23 Feb
  11. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
  12. 2021VideoGPT: Video Generation using VQ-VAE and Transformers20 Apr
1 more
  1. 2021Learning Transferable Visual Models From Natural Language Supervision26 Feb

Other references · 27

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  3. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  4. 2022Video Diffusion Modelscited by 2,305
  5. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  6. 2018World Modelscited by 1,513
  7. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
  8. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 637
  9. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
  10. 2023LightGlue: Local Feature Matching at Light Speedcited by 590
  11. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
  12. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
15 more
  1. 2025LongLive: Real-time Interactive Long Video Generationcited by 265
  2. 2016Temporal Generative Adversarial Nets with Singular Value Clippingcited by 198
  3. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 146
  4. 2025VMem: Consistent Interactive Video Scene Generation with Surfel-Indexed View Memorycited by 109
  5. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 84
  6. 2024BoQ: A Place is Worth a Bag of Learnable Queriescited by 64
  7. 2025VMBench: A Benchmark for Perception-Aligned Video Motion Generationcited by 49
  8. 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokenscited by 27
  9. 2025FingER: Content Aware Fine-grained Evaluation with Reasoning for AI-Generated Videoscited by 22
  10. 2025NarrLV: Towards a Comprehensive Narrative-Centric Evaluation for Long Video Generationcited by 22
  11. 2026LongLive-RAG: A General Retrieval-Augmented Framework for Long Video Generationcited by 16
  12. 2025Recurrent Autoregressive Diffusion: Global Memory Meets Local Attentioncited by 9
  13. 2026SlotMemory: Object-Centric KV Memory for Streaming Long-Video Generationcited by 6
  14. 2024MutualVPR: A Mutual Learning Framework for Resolving Supervision Inconsistencies via Adaptive Clusteringcited by 5
  15. 2026Attend Locally, Remember Linearly: Linear Attention as Cross-Frame Memory for Autoregressive Video Diffusioncited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environments
  2. 2025MagicWorld: Towards Long-Horizon Stability for Interactive Video World Exploration
  3. 2025Video World Models with Long-term Spatial Memory
  4. 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models
  5. 2026Beyond Pixel Histories: World Models with Persistent 3D State
  6. 2026MIND: Benchmarking Memory Consistency and Action Control in World Models
  7. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
  8. 2026Echo-Memory: A Controlled Study of Memory in Action World Models