mlsanityData to 7 Oct 2026

LayerRoute: Action-Conditioned Mixture-of-Layers Routing for Vision-Language-Action Policies

arXiv 2609.06079 ↗First posted 5 Sep 2026cs.AI cs.LGcited by 1

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

also in 1 more
Abstract (arXiv)

Vision-Language-Action (VLA) policies leverage pretrained vision-language models (VLMs) to guide action generation for robot control. VLMs provide hierarchical visual-semantic representations that evolve across layers, from local visual geometry to abstract, language-aligned semantics; different manipulation tasks may therefore require different mixtures of layer representations. Meanwhile, the action module maintains intermediate representations that evolve throughout action computation and may provide useful information for subsequent decisions. However, existing VLA interfaces offer limited flexibility in representation access: VLM information is exposed through fixed layer assignments for each action layer, while intermediate action states are only propagated implicitly through residual streams without explicit reuse. We introduce LayerRoute, an action-conditioned representation routing interface that enables adaptive access to VLM layers and action representations. The Layer Mixture Router dynamically forms mixtures of cached VLM representations, while Action-State Reread reuses earlier action representations. Across diverse simulation and real-world benchmarks, LayerRoute consistently improves StarVLA-π and π0.5, achieving up to 7.2 gains on LIBERO Long with only 0.31% / 3.87% additional parameters. Ablation studies validate the benefit of action-conditioned layer routing, while routing analyses reveal structured allocation patterns across action layers and task settings.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 29 of its 36 references that are in the map. First posted on arXiv 5 Sep 2026.

Builds on

29 of 36 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr
  2. 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsification28 Aug
  3. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better29 May
  4. 2025MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation26 Mar
  5. 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution4 Nov

Other references · 24

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  3. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  4. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  5. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  6. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  7. 2016Deep Networks with Stochastic Depthcited by 973
  8. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  9. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 671
  10. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  11. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  12. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
12 more
  1. 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
  2. 2023Interpreting CLIP's Image Representation via Text-Based Decompositioncited by 189
  3. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
  4. 2015Training Very Deep Networkscited by 172
  5. 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Cachingcited by 83
  6. 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extractioncited by 54
  7. 2024DenseFormer: Enhancing Information Flow in Transformers via Depth Weighted Averagingcited by 48
  8. 2025HAMLET: Switch your Vision-Language-Action Model into a History-Aware Policycited by 42
  9. 2025MiMo-Embodied: X-Embodied Foundation Model Technical Reportcited by 36
  10. 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attentioncited by 22
  11. 2025FedVLA: Federated Vision-Language-Action Learning with Dual Gating Mixture-of-Experts for Robotic Manipulationcited by 18
  12. 2026Planning Takes More Than Token Prediction: Causal Plan for Benchmarking and Building Physically Grounded Embodied Reasonerscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models
  2. 2026The Layer Mystery of VLA: An Information-Theoretical Analysis of VLA Latent Interface
  3. 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models
  4. 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
  5. 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think
  6. 2026LoopVLA: Learning Sufficiency in Recurrent Refinement for Vision-Language-Action Models
  7. 2026LIRA: Local Cross-Layer Information Routing for Vision-Language-Action Decoding
  8. 2026eRLT: Efficient VLA Reinforcement Learning via Action-Relevant Token Routing