mlsanityData to 7 Oct 2026

Action Hallucination in Generative Vision-Language-Action Models

arXiv 2602.06339 ↗First posted 6 Feb 2026cs.RO cs.AIcited by 5

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Robot Foundation Models, such as VLAs, promise end-to-end generative robot policies with broad generalization. Yet it remains unclear whether they fundamentally resolve the core problem of action generation in embodied settings, or overcome the long-standing challenges of robotics. We address this question by analyzing action hallucinations that violate physical constraints and their extension to plan-level failures. Focusing on latent-variable generative policies, we show that hallucinations can arise from structural mismatches between feasible robot behavior and common model architectures. We study three such barriers -- topological, precision, and horizon -- and show how they impose unavoidable tradeoffs. Our analysis provides mechanistic explanations for reported empirical failures of generative robot policies and suggests principled directions for improving reliability and trustworthiness, without abandoning their expressive power.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 37 of its 53 references that are in the map. First posted on arXiv 6 Feb 2026.

Builds on

37 of 53 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 34

  1. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  2. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  3. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  4. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  5. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  6. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  7. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  9. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  10. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
  11. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
  12. 2025π*0.6: a VLA That Learns From Experiencecited by 280
22 more
  1. 2023Large Language Models as Commonsense Knowledge for Large-Scale Task Planningcited by 231
  2. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
  3. 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
  4. 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
  5. 2023Calibrated Language Models Must Hallucinatecited by 114
  6. 2024FlowPolicy: Enabling Fast and Robust 3D Flow-based Policy via Consistency Flow Matching for Robot Manipulationcited by 99
  7. 2024Understanding Hallucinations in Diffusion Models through Mode Interpolationcited by 87
  8. 2025RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Modelscited by 56
  9. 2024Towards Diverse Behaviors: A Benchmark for Imitation Learning with Human Demonstrationscited by 51
  10. 2021Resampling Base Distributions of Normalizing Flowscited by 42
  11. 2022Can Push-forward Generative Models Fit Multimodal Distributions?cited by 41
  12. 2025Much Ado About Noising: Dispelling the Myths of Generative Robotic Controlcited by 35
  13. 2025Monte Carlo Tree Diffusion for System 2 Planningcited by 33
  14. 2018Disconnected Manifold Learning for Generative Adversarial Networkscited by 27
  15. 2020Learning disconnected manifolds: a no GANs landcited by 25
  16. 2025SafeFlow: Safe Robot Motion Planning with Flow Matching via Control Barrier Functionscited by 12
  17. 2025VFP: Variational Flow-Matching Policy for Multi-Modal Robot Manipulationcited by 9
  18. 2026Abstracting Robot Manipulation Skills via Mixture-of-Experts Diffusion Policiescited by 8
  19. 2024Diffusion Meets Options: Hierarchical Generative Skill Composition for Temporally-Extended Taskscited by 7
  20. 2025Hybrid Diffusion for Simultaneous Symbolic and Continuous Planningcited by 6
  21. 2025ManiTaskGen: A Comprehensive Task Generator for Benchmarking and Improving Vision-Language Agents on Embodied Decision-Makingcited by 4
  22. 2022Unveiling the Latent Space Geometry of Push-Forward Generative Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025HEAL: An Empirical Study on Hallucinations in Embodied Agents Driven by Large Language Models
  2. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines
  3. 2024Task Success is not Enough: Investigating the Use of Video-Language Models as Behavior Critics for Catching Undesirable Agent Behaviors
  4. 2026Do World Models Make Better Robots? A Survey of Evaluation Benchmarks for Predictive Embodied Intelligence
  5. 2026A Comprehensive Review of Generative Physical Artificial Intelligence
  6. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
  7. 2026The Yes-Man Syndrome: Benchmarking Abstention in Embodied Robotic Agents
  8. 2024The Duality of Generative AI and Reinforcement Learning in Robotics: A Review