mlsanityData to 7 Oct 2026

PAIR: Bridging Perception and Action in Vision-Language-Action Models

arXiv 2610.09016 ↗First posted 6 Oct 2026cs.AIcited by 0

On the map: Vision-language-action models → VLA architectures and generalization also fits: Generalist VLA models and benchmarks

Abstract (arXiv)

Vision-language-action (VLA) models map visual observations and language instructions to continuous robot actions. This task requires a transition from representations that describe the scene and instruction to representations that support action generation. Many continuous-action VLAs leave this transition implicit and supervise it mainly through the final action-prediction loss. We introduce PAIR, a framework that learns a shared perception-action representation between these two spaces. During training, a Masked Action Autoencoder encodes expert action chunks into horizon-aligned Action Latent Tokens. A Bridge Module extracts task-relevant features from the current visual-language representations. PAIR aligns these features with the Action Latent Tokens to form Bridge Tokens that preserve task information and capture the structure of expert actions. The Bridge Tokens are then projected into the action-token space and injected into the initial Action Tokens, providing an action-ready starting point for Action Expert refinement. At inference, the autoencoder is removed, and the Bridge Tokens are generated only from the current observation and instruction. Experiments on LIBERO, LIBERO-Plus, and CALVIN ABC-D show gains for the evaluated OpenVLA-OFT and VLA-Adapter models. On LIBERO-Plus, PAIR raises VLA-Adapter's success rate from 59.1% to 64.2%. On CALVIN, it increases VLA-Adapter's average completed sequence length from 4.42 to 4.53. Across seven real-world tasks, PAIR raises OpenVLA-OFT's success rate from 51.4% to 65.0%. Representation analyses show that Bridge Tokens retain task information while making continuous-action information accessible before Action Expert refinement. These results support a shared intermediate representation as a useful interface between perception and action in continuous-action VLAs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in VLA architectures and generalization, one of 13 directions in Vision-language-action models. First posted on arXiv 6 Oct 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Lost in Reconstruction: Aligning Action Representations with Language in Vision-Language-Action Models
  2. 2026G0.5: One Autoregressive Stream for Robot Reasoning and Action
  3. 2026LARA: Latent Action Representation Alignment for Vision-Language-Action Models
  4. 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models
  5. 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models
  6. 2026Semantic Anchoring for Robotic Action Representations
  7. 2026Beyond World-Frame Action Heads: Motion-Centric Action Frames for Vision-Language-Action Models
  8. 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representations