ActiveVLA: Injecting Active Perception into Vision-Language-Action Models for Precise 3D Robotic Manipulation
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 1 more
Abstract (arXiv)
Recent advances in robot manipulation have leveraged pre-trained vision-language models (VLMs) and explored integrating 3D spatial signals into these models for effective action prediction, giving rise to the promising vision-language-action (VLA) paradigm. However, most existing approaches overlook the importance of active perception: they typically rely on static, wrist-mounted cameras that provide an end-effector-centric viewpoint. As a result, these models are unable to adaptively select optimal viewpoints or resolutions during task execution, which significantly limits their performance in long-horizon tasks and fine-grained manipulation scenarios. To address these limitations, we propose ActiveVLA, a novel vision-language-action framework that empowers robots with active perception capabilities for high-precision, fine-grained manipulation. ActiveVLA adopts a coarse-to-fine paradigm, dividing the process into two stages: (1) Critical region localization. ActiveVLA projects 3D inputs onto multi-view 2D projections, identifies critical 3D regions, and supports dynamic spatial awareness. (2) Active perception optimization. Drawing on the localized critical regions, ActiveVLA uses an active view selection strategy to choose optimal viewpoints. These viewpoints aim to maximize amodal relevance and diversity while minimizing occlusions. Additionally, ActiveVLA applies a 3D zoom-in to improve resolution in key areas. Together, these steps enable finer-grained active perception for precise manipulation. Extensive experiments demonstrate that ActiveVLA achieves precise 3D manipulation and outperforms state-of-the-art baselines on three simulation benchmarks. Moreover, ActiveVLA transfers seamlessly to real-world scenarios, enabling robots to learn high-precision tasks in complex environments.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 61 of its 64 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
61 of 64 references.
Closest ancestors · 9
Same direction, newest first
- 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models9 Jun
- 2025PointVLA: Injecting the 3D World into Vision-Language-Action Models10 Mar
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control9 Feb
- 2024QUART-Online: Latency-Free Large Multimodal Language Model for Quadruped Robot Learning20 Dec
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
- 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learning17 Jun
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics15 Jun
- 2023Vision-Language Foundation Models as Effective Robot Imitators2 Nov
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 52
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
38 more
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 694
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 523
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
- 2023An Embodied Generalist Agent in 3D Worldcited by 365
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
- 2022Masked Visual Pre-training for Motor Controlcited by 248
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 225
- 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 183
- 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 138
- 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 137
- 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 133
- 2024LLaVA-Phi: Efficient Multi-Modal Assistant with Small Language Modelcited by 129
- 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 122
- 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 113
- 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inferencecited by 97
- 2022Instruction-driven history-aware policies for robotic manipulationscited by 94
- 2024DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agentscited by 68
- 2023PolarNet: 3D Point Clouds for Language-Guided Robotic Manipulationcited by 56
- 2025VLAS: Vision-Language-Action Model With Speech Instructions For Customized Robot Manipulationcited by 51
- 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 46
- 2025Humanoid-VLA: Towards Universal Humanoid Control with Visual Integrationcited by 45
- 2024Towards Generalizable Vision-Language Robotic Manipulation: A Benchmark and LLM-guided 3D Policycited by 38
- 2025FP3: A 3D Foundation Policy for Robotic Manipulationcited by 32
- 2025ReasonGrounder: LVLM-Guided Hierarchical Feature Splatting for Open-Vocabulary 3D Visual Grounding and Reasoningcited by 25
- 2024Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Modelscited by 24
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 18.
18 papers.
Sort:
By area:
- 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loopcited by 26
- 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imaginationcited by 3
- 2026WeaveLA: Event Driven Cross-Subtask Latent Memory Weaving for Repetitive Robot Manipulationcited by 2
- 2026LIME: Learning Intent-aware Camera Motion from Egocentric Videocited by 2
- 2026Thinking with Cameras: Active Visual Reasoning via Dynamic Viewpoint Control for Surveillance Video Understandingcited by 1
- 2026A3R: Agentic Affordance Reasoning via Cross-Dimensional Evidence in 3D Gaussian Scenescited by 0
- 2026VADF: Vision-Adaptive Diffusion Policy Framework for Efficient Robotic Manipulationcited by 0
- 2026CertVLA: Certified Defense against Physical Visual Attacks for Vision-Language-Action Modelscited by 0
- 2026GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulationcited by 0
- 2026INSPECT: Learning Robot View Selection from Assistant Usecited by 0
- 2026ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulationcited by 0
- 2026Beyond the Current Scene: Event-Referential Grasping with Active View Selectioncited by 0
6 more
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLAcited by 0
- 2026ROMA: LLM System for Real-World Object-Centric Multi-Sensory Active Perceptioncited by 0
- 2026RoboQuest: Generalist Physical Agents that Search, Inspect and Testcited by 0
- 2026VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulationcited by 0
- 2026Fly-by-Code: Embodied Coding Agents for Aerial Manipulation with Active Visual and Physical Feedbackcited by 0
- 2026FoveaVLA: Foveation Actions Replace the Wrist Camera in VLAscited by 0
- 2026FoveaVLA: Foveation Actions Replace the Wrist Camera in VLAs14 Oct 2026
- 2026Fly-by-Code: Embodied Coding Agents for Aerial Manipulation with Active Visual and Physical Feedback8 Oct 2026
- 2026VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulation8 Oct 2026
- 2026RoboQuest: Generalist Physical Agents that Search, Inspect and Test7 Oct 2026
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLA4 Oct 2026
- 2026ROMA: LLM System for Real-World Object-Centric Multi-Sensory Active Perception3 Oct 2026
- 2026Beyond the Current Scene: Event-Referential Grasping with Active View Selection30 Sep 2026
- 2026ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulation21 Sep 2026
- 2026INSPECT: Learning Robot View Selection from Assistant Use17 Sep 2026
- 2026Thinking with Cameras: Active Visual Reasoning via Dynamic Viewpoint Control for Surveillance Video Understanding6 Sep 2026
- 2026GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulation27 Aug 2026
- 2026CertVLA: Certified Defense against Physical Visual Attacks for Vision-Language-Action Models21 Aug 2026
6 more
- 2026LIME: Learning Intent-aware Camera Motion from Egocentric Video2 Jul 2026
- 2026WeaveLA: Event Driven Cross-Subtask Latent Memory Weaving for Repetitive Robot Manipulation16 Jun 2026
- 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination9 Jun 2026
- 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loop18 May 2026
- 2026VADF: Vision-Adaptive Diffusion Policy Framework for Efficient Robotic Manipulation17 Apr 2026
- 2026A3R: Agentic Affordance Reasoning via Cross-Dimensional Evidence in 3D Gaussian Scenes2 Apr 2026
- 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imaginationcited by 3
- 2026WeaveLA: Event Driven Cross-Subtask Latent Memory Weaving for Repetitive Robot Manipulationcited by 2
- 2026CertVLA: Certified Defense against Physical Visual Attacks for Vision-Language-Action Modelscited by 0
- 2026GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulationcited by 0
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLAcited by 0
- 2026VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulationcited by 0
- 2026FoveaVLA: Foveation Actions Replace the Wrist Camera in VLAscited by 0
- 2026FoveaVLA: Foveation Actions Replace the Wrist Camera in VLAs14 Oct 2026
- 2026VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulation8 Oct 2026
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLA4 Oct 2026
- 2026GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulation27 Aug 2026
- 2026CertVLA: Certified Defense against Physical Visual Attacks for Vision-Language-Action Models21 Aug 2026
- 2026WeaveLA: Event Driven Cross-Subtask Latent Memory Weaving for Repetitive Robot Manipulation16 Jun 2026
- 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imagination9 Jun 2026
- 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loopcited by 26
- 2026LIME: Learning Intent-aware Camera Motion from Egocentric Videocited by 2
- 2026INSPECT: Learning Robot View Selection from Assistant Usecited by 0
- 2026ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulationcited by 0
- 2026Beyond the Current Scene: Event-Referential Grasping with Active View Selectioncited by 0
- 2026ROMA: LLM System for Real-World Object-Centric Multi-Sensory Active Perceptioncited by 0
- 2026ROMA: LLM System for Real-World Object-Centric Multi-Sensory Active Perception3 Oct 2026
- 2026Beyond the Current Scene: Event-Referential Grasping with Active View Selection30 Sep 2026
- 2026ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulation21 Sep 2026
- 2026INSPECT: Learning Robot View Selection from Assistant Use17 Sep 2026
- 2026LIME: Learning Intent-aware Camera Motion from Egocentric Video2 Jul 2026
- 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loop18 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardware
- 20253D CAVLA: Leveraging Depth and 3D Context to Generalize Vision Language Action Models for Unseen Tasks
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
- 2026SaPaVe: Towards Active Perception and Manipulation in Vision-Language-Action Models for Robotics
- 2026BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulation
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review