LIRA: Local Cross-Layer Information Routing for Vision-Language-Action Decoding
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 1 more
Abstract (arXiv)
Vision-Language-Action (VLA) models transform representations from pretrained vision-language models (VLMs) into robot actions, yet the interface that routes intermediate VLM features into action decoders remains underexplored. Existing designs either expose only a narrow part of the representation hierarchy or rigidly match each decoder block to one VLM layer, restricting access to complementary task evidence across depths. We introduce LIRA, a local cross-layer action-conditioning mechanism that formulates VLM-to-action conditioning as depth-aware information routing. LIRA operates on task-token features and LIRA Query features derived from intermediate VLM states, then assigns each Parallel Fusion Block a depth-aligned local window centered on its corresponding VLM layer. Parallel Fusion Blocks aggregate neighboring LIRA Query features and integrate them with task-token features and proprioceptive inputs before action prediction. This routing interface leaves the backbone architecture, action decoder, and supervised training recipe unchanged. Across LIBERO, LIBERO-Plus, CALVIN ABCrightarrowD, and real-world manipulation, LIRA improves the principal aggregate metrics over the VLA-Adapter baseline under the same 0.5B-parameter configuration. In zero-shot transfer to LIBERO-Plus, LIRA increases average success from 59.1% to 78.0%, an 18.9-point gain indicating improved robustness under controlled distribution shifts.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 33 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
26 of 33 references.
Closest ancestors · 6
Same direction, newest first
- 2026AffordanceVLA: A Vision-Language-Action Model Empowering Action Generation through Affordance-Aware Understanding4 Jun
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model11 Sep
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
- 2023PaLM-E: An Embodied Multimodal Language Model6 Mar
Other references · 20
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2017Deep Layer Aggregationcited by 436
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learningcited by 166
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
8 more
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 141
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 120
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decodingcited by 88
- 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulationcited by 79
- 2026MolmoAct2: Action Reasoning Models for Real-world Deploymentcited by 45
- 2026RotVLA: Rotational Latent Action for Vision-Language-Action Modelcited by 7
- 2026AffordVLA: Injecting Affordance Representations into Vision-Language-Action Models via Implicit Feature Alignmentcited by 5
- 2026BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuningcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026LayerRoute: Action-Conditioned Mixture-of-Layers Routing for Vision-Language-Action Policies
- 2026G0.5: One Autoregressive Stream for Robot Reasoning and Action
- 2026PAIR: Bridging Perception and Action in Vision-Language-Action Models
- 2026Let It Be Simple: One-Step Action Generation for Vision-Language-Action Models
- 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think
- 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models
- 2026CLAP: Direct VLM-to-VLA Adaptation via Language-Action Grounding
- 2026Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models