mlsanityData to 7 Oct 2026

How Should Vision-Language-Action Models Use Proprioceptive State?

arXiv 2608.03052 ↗First posted 4 Aug 2026cs.ROcited by 1

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Recent Vision-Language-Action (VLA) models almost universally take robot proprioceptive state as input, yet wire it in incompatible ways -- serialized into text prompts, projected into the vision-language prefix, or fed directly to the action expert -- and almost always as a single current frame. Three questions remain open: (1) whether, and on which tasks, current state actually improves closed-loop control; (2) how much state history helps, and whether its benefit reflects genuine temporal variation rather than added conditioning capacity; and (3) where state should enter the model -- the vision-language backbone or the action-generation module. We answer these questions through controlled experiments on a flow-matching VLA, fixing the backbone, training data, action representation, and evaluation protocol throughout. We implement five representative interfaces -- discrete state prompt, VLM prefix, action prefix, state expert, and feature modulation -- under matched implementation details, and evaluate them on 45 atomic tasks spanning three task families plus 20 composite tasks; we then sweep the state-history length from 1 to 96 frames to examine how historical state information affects model performance. The experiments yield systematic answers to all three questions, distilled into testable design principles for state-aware VLAs.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 27 of its 30 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

27 of 30 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026TwinBrainVLA: Unleashing the Potential of Generalist VLMs for Embodied Tasks via Asymmetric Mixture-of-Transformers20 Jan
  2. 2025Contrastive Representation Regularization for Vision-Language-Action Models2 Oct
  3. 2025ROSA: Harnessing Robot States for Vision-Language and Action Alignment16 Jun
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
  5. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
  7. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun

Other references · 20

  1. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  2. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  3. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  4. 2019Causal Confusion in Imitation Learningcited by 286
  5. 2022Recurrent Memory Transformercited by 197
  6. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
  7. 2020Fighting Copycat Agents in Behavioral Cloning from Observation Historiescited by 70
  8. 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
  9. 2026RoboMME: Benchmarking and Understanding Memory for Robotic Generalist Policiescited by 39
  10. 2026CLAP: Contrastive Latent Action Pretraining for Learning Vision-Language-Action Models from Human Videoscited by 27
  11. 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulationcited by 10
  12. 2025LoLA: Long Horizon Latent Action Learning for General Robot Manipulationcited by 8
8 more
  1. 2026When would Vision-Proprioception Policies Fail in Robotic Manipulation?cited by 8
  2. 2026A Brain-inspired Embodied Intelligence for Fluid and Fast Reflexive Robotics Controlcited by 5
  3. 2026ReViP: Mitigating False Completion in Vision-Language-Action Models with Vision-Proprioception Rebalancecited by 5
  4. 2026Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Actioncited by 4
  5. 2026Understanding the Impact of Geometric Foundation Models on Vision-Language-Action Modelscited by 4
  6. 2025Tenma: Robust Cross-Embodiment Robot Manipulation with Diffusion Transformercited by 3
  7. 2026From Pixels to Tokens: A Systematic Study of Latent Action Supervision for Vision-Language-Action Modelscited by 2
  8. 2025Continuous Vision-Language-Action Co-Learning with Semantic-Physical Alignment for Behavioral Cloningcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
  2. 2026Think Proprioceptively: State-Grounded Visual Token Selection for VLA Policies
  3. 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
  4. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines
  5. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
  6. 2026Not All Features Are Created Equal: A Mechanistic Study of Vision-Language-Action Models
  7. 2026ActionGround: Training-Free Runtime Refinement of Frozen VLA Policies
  8. 2024What Matters in Building Vision-Language-Action Models for Generalist Robots