CT-VAM: A Cerebello-Thalamic-Inspired Vision-Action Model for Efficient Visuomotor Control
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-language-action models have shown strong promise for robot manipulation, yet raw language is primarily needed to specify task intent rather than to be repeatedly processed during high-frequency low-level execution. Motivated by this separation, we propose a cerebello-thalamic-inspired vision-action model (CT-VAM) for efficient task-conditioned visuomotor control. CT-VAM acts as a compact local execution policy that predicts action chunks from dualview visual observations, proprioception, and a lightweight task condition, potentially enabling a practical cloud-edge paradigm in which high-level semantic reasoning can be handled by large models while fast closed-loop control runs on local hardware. To fuse heterogeneous inputs effectively, CT-VAM introduces TARS (Thalamic Action Routing Stream), a stream-separated conditional attention decoder that independently routes action, visual and task streams, preventing dense sensory tokens from overwhelming compact task-relevant conditions. With only 68M parameters, CT-VAM achieves LIBERO success rates competitive with substantially larger VLA models, while reducing inference latency. Together with flow-consistent inpainting for asynchronous chunk execution, CT-VAM supports high-frequency control and demonstrates robust realworld deployment on resource-constrained robotic platforms.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 23 of its 29 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
23 of 29 references.
Closest ancestors · 2
Same direction, newest first
- 2025BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulation9 Jun
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan
Other references · 21
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2025DINOv3cited by 1,414
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
9 more
- 2023Vision Transformers Need Registerscited by 871
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2024Latent Action Pretraining from Videoscited by 321
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 145
- 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 134
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SaiVLA-0: Cerebrum--Pons--Cerebellum Tripartite Architecture for Compute-Aware Vision-Language-Action
- 2026TFP: Temporally Conditioned Memory-Fusion Policies for Visuomotor Learning
- 2026CereVLA: Cerebellum-Inspired Consequence-Aware Residual Governance for Efficient Vision-Language-Action Execution
- 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models
- 2026Critic in the Loop: A Tri-System VLA Framework for Robust Long-Horizon Manipulation
- 2026HSC-VLA: Hierarchical Scene-Clearing for Robust Bimanual Manipulation in Dense Clutter ↗
- 2026Closed-Loop Neural Activation Control in Vision-Language-Action Models
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation