mlsanityData to 7 Oct 2026

World Action Verifier: Self-Improving World Models via Forward-Inverse Asymmetry

arXiv 2604.01985 ↗First posted 2 Apr 2026cs.LG cs.AI cs.ROcited by 13

On the map: World models → Embodied and robot world models

Abstract (arXiv)

General-purpose world models promise scalable policy evaluation, optimization, and planning, yet achieving the required level of robustness remains challenging. Unlike policy learning which primarily focuses on optimal actions, a world model needs to be reliable over a vast space of suboptimal actions, which are often underrepresented in action-labeled robot interactions. To address this challenge, we propose World Action Verifier (WAV), a framework that enables world models to identify their own prediction errors and self-improve. The key idea is to decompose action-conditioned state prediction into two independently verifiable factors: state plausibility and action reachability. We show that verifying these factors is significantly more tractable than direct forward prediction due to two underlying asymmetries: the broader availability of action-free data and the lower dimensionality of action-relevant features. Leveraging these asymmetries, we augment a world model with (i) a diverse subgoal generator obtained from video corpora and (ii) a sparse inverse model that infers actions from a subset of state features. By enforcing cycle consistency among proposed subgoals, inferred actions, and forward rollouts, WAV provides an effective verification mechanism in under-explored regimes, where existing methods often fail. Across nine tasks spanning MiniGrid, RoboMimic, and ManiSkill, our method achieves 2x higher sample efficiency while improving downstream policy performance by over 22%.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 90 of its 142 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

90 of 142 references.

Closest ancestors · 20

Same direction, newest first

  1. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
  2. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  3. 2026World2Act: Latent Action Post-Training from World Model Dynamics11 Mar
  4. 2026World Action Models are Zero-shot Policies17 Feb
  5. 2026VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Model12 Feb
  6. 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videos6 Feb
  7. 2026World-VLA-Loop: Closed-Loop Learning of Video World Model and VLA Policy6 Feb
  8. 2026Causal World Modeling for Robot Control29 Jan
  9. 2026PointWorld: Scaling 3D World Models for In-The-Wild Robotic Manipulation7 Jan
  10. 2025Motus: A Unified Latent Action World Model15 Dec
  11. 2025Evaluating Gemini Robotics Policies in a Veo World Simulator11 Dec
  12. 2025Ctrl-World: A Controllable Generative World Model for Robot Manipulation11 Oct
8 more
  1. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
  2. 2025WorldGym: World Model as An Environment for Policy Evaluation31 May
  3. 2025WorldEval: World Model as Real-World Robot Policies Evaluator25 May
  4. 2025FLARE: Robot Learning with Implicit World Modeling21 May
  5. 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
  6. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasets3 Apr
  7. 2025Inference-Time Enhancement of Generative Robot Policies via Predictive World Modeling2 Feb
  8. 2024IRASim: A Fine-Grained World Model for Robot Manipulation20 Jun

Other references · 70

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2017Neural Discrete Representation Learningcited by 4,650
  3. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  5. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  6. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  7. 2023Mastering Diverse Domains through World Modelscited by 1,193
  8. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
  9. 2018Exploration by Random Network Distillationcited by 966
  10. 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 734
  11. 2016Unifying Count-Based Exploration and Intrinsic Motivationcited by 632
  12. 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 484
38 more
  1. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
  2. 2024Generative Verifiers: Reward Modeling as Next-Token Predictioncited by 465
  3. 2023Learning Interactive Real-World Simulatorscited by 440
  4. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  5. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  6. 2022DayDreamer: World Models for Physical Robot Learningcited by 372
  7. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 357
  8. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  9. 2017Count-Based Exploration with Neural Density Modelscited by 255
  10. 2017Automated Curriculum Learning for Neural Networkscited by 251
  11. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
  12. 2025R-Zero: Self-Evolving Reasoning LLM from Zero Datacited by 210
  13. 2025Unified Video Action Modelcited by 195
  14. 2015Incentivizing Exploration In Reinforcement Learning With Deep Predictive Modelscited by 154
  15. 2025Training Agents Inside of Scalable World Modelscited by 122
  16. 2018Model-Based Active Explorationcited by 105
  17. 2024Steering Your Generalists: Improving Robotic Foundation Models via Value Guidancecited by 100
  18. 2025SPIRAL: Self-Play on Zero-Sum Games Incentivizes Reasoning via Multi-Agent Multi-Turn Reinforcement Learningcited by 89
  19. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 85
  20. 2017Surprise-Based Intrinsic Motivation for Deep Reinforcement Learningcited by 83
  21. 2025SPICE: Self-Play In Corpus Environments Improves Reasoningcited by 78
  22. 2024Learning and Leveraging World Models in Visual Representation Learningcited by 71
  23. 2026WorldArena: A Unified Benchmark for Evaluating Perception and Functional Utility of Embodied World Modelscited by 68
  24. 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 67
  25. 2025Large Video Planner Enables Generalizable Robot Controlcited by 67
  26. 2025WoW: Towards a World omniscient World model Through Embodied Interactioncited by 66
  27. 2025Multi-Agent Verification: Scaling Test-Time Compute with Multiple Verifierscited by 58
  28. 2025RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Modelscited by 56
  29. 2025Inference-time Scaling of Diffusion Models through Classical Searchcited by 48
  30. 2026InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulationcited by 48
  31. 2024Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Samplingcited by 46
  32. 2023Finetuning Offline World Models in the Real Worldcited by 39
  33. 2024Nonparametric Partial Disentanglement via Mechanism Sparsity: Sparse Actions, Interventions and Sparse Temporal Dependenciescited by 39
  34. 2025CLAM: Continuous Latent Action Models for Robot Learning from Unlabeled Demonstrationscited by 39
  35. 2026RoboMME: Benchmarking and Understanding Memory for Robotic Generalist Policiescited by 39
  36. 2025PAN: A World Model for General, Actionable, and Long-Horizon World Simulationcited by 36
  37. 2018Learning to Play with Intrinsically-Motivated Self-Aware Agentscited by 34
  38. 2025Robot Data Curation with Mutual Information Estimatorscited by 34

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026Do Robotic World Models Really Follow Actions? Diagnosing and Aligning Action-Conditioned Generation for Policy Learning
  2. 2026Enhancing Policy Learning with World-Action Model
  3. 2026DualWAM: Dual-System World Action Models for Asynchronous Global Planning and Local Refinement
  4. 2026World-Action Models for Robot Learning and Control: A Survey
  5. 2026OpenWAM: An Open Framework for Composable World-Action Models
  6. 2026On the Capability Separation Between World-Model Policy Learning and Imitated World-Action Models
  7. 2026GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch
  8. 2026Feedback World Model Enables Precise Guidance of Diffusion Policy