mlsanityData to 14 Oct 2026

Does VLA Even Know the Basics? Measuring Commonsense and World Knowledge Retention in Vision-Language-Action Models

arXiv 2606.19297 ↗First posted 17 Jun 2026cs.LG cs.ROcited by 0

On the map: Vision-language-action models → Reasoning and chain-of-thought in VLA

Abstract (arXiv)

Embodied Vision-Language-Action (VLA) models are typically obtained by fine-tuning powerful pretrained VLMs on robotics data, yet it is unclear how much commonsense and factual knowledge they retain after adaptation. Failures on knowledge-sensitive tasks are ambiguous, conflating missing knowledge with poor generalization of low-level control. We introduce Act2Answer, a lightweight protocol that adapts VLM knowledge benchmarks to VLA evaluation by requiring agents to answer through action. Each question becomes a short tabletop episode where the agent performs a single object-placement action to select among candidate answers, yielding an action-grounded success rate with reduced control confounds. We curate a test suite of such environments across diverse commonsense and world-knowledge categories and introduce layerwise intent probing to localize answer-relevant information across the VLM backbone and action head. In a large-scale study of 7 VLA models and 9 VLM baselines, we systematically rank models across categories, finding that VLAs show solid performance on simple concepts while exhibiting larger gaps on richer semantic categories relative to their source VLMs, that VQA co-training is associated with better knowledge retention, and that answer-relevant signals peak in middle VLA layers but attenuate in upper layers. Act2Answer is available at https://tttonyalpha.github.io/act2answer/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning and chain-of-thought in VLA, one of 13 directions in Vision-language-action models. Builds on 23 of its 31 references that are in the map. First posted on arXiv 17 Jun 2026.

Builds on

23 of 31 references.

References · 23

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  2. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  3. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  4. 2019Towards VQA Models That Can Readcited by 1,718
  5. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  6. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  7. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  8. 2016A Diagram Is Worth A Dozen Imagescited by 804
  9. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
  10. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
  11. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  12. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
11 more
  1. 2025π*0.6: a VLA That Learns From Experiencecited by 303
  2. 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
  3. 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 175
  4. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoningcited by 164
  5. 2025Memory, Benchmark & Robots: A Benchmark for Solving Complex Tasks with Reinforcement Learningcited by 36
  6. 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalizationcited by 35
  7. 2024MLLM-CompBench: A Comparative Reasoning Benchmark for Multimodal LLMscited by 32
  8. 2024ManiSkill-HAB: A Benchmark for Low-Level Manipulation in Home Rearrangement Taskscited by 22
  9. 2025Spatial Traces: Enhancing VLA Models with Spatial-Temporal Understandingcited by 11
  10. 2025AmbiK: Dataset of Ambiguous Tasks in Kitchen Environmentcited by 9
  11. 2025Bring the Apple, Not the Sofa: Impact of Irrelevant Context in Embodied AI Commands on VLA Modelscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines
  2. 2026RoboSemanticBench: Diagnosing Semantic Grounding in Action Prediction for VLA Models
  3. 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challenges
  4. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
  5. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better
  6. 202510 Open Challenges Steering the Future of Vision-Language-Action Models
  7. 2026VLM4VLA: Revisiting Vision-Language-Models in Vision-Language-Action Models
  8. 2024A Survey on Vision-Language-Action Models for Embodied AI