mlsanityData to 14 Oct 2026

ActiveVLA: Injecting Active Perception into Vision-Language-Action Models for Precise 3D Robotic Manipulation

arXiv 2601.08325 ↗First posted 13 Jan 2026cs.ROcited by 18

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

also in 1 more
Abstract (arXiv)

Recent advances in robot manipulation have leveraged pre-trained vision-language models (VLMs) and explored integrating 3D spatial signals into these models for effective action prediction, giving rise to the promising vision-language-action (VLA) paradigm. However, most existing approaches overlook the importance of active perception: they typically rely on static, wrist-mounted cameras that provide an end-effector-centric viewpoint. As a result, these models are unable to adaptively select optimal viewpoints or resolutions during task execution, which significantly limits their performance in long-horizon tasks and fine-grained manipulation scenarios. To address these limitations, we propose ActiveVLA, a novel vision-language-action framework that empowers robots with active perception capabilities for high-precision, fine-grained manipulation. ActiveVLA adopts a coarse-to-fine paradigm, dividing the process into two stages: (1) Critical region localization. ActiveVLA projects 3D inputs onto multi-view 2D projections, identifies critical 3D regions, and supports dynamic spatial awareness. (2) Active perception optimization. Drawing on the localized critical regions, ActiveVLA uses an active view selection strategy to choose optimal viewpoints. These viewpoints aim to maximize amodal relevance and diversity while minimizing occlusions. Additionally, ActiveVLA applies a 3D zoom-in to improve resolution in key areas. Together, these steps enable finer-grained active perception for precise manipulation. Extensive experiments demonstrate that ActiveVLA achieves precise 3D manipulation and outperforms state-of-the-art baselines on three simulation benchmarks. Moreover, ActiveVLA transfers seamlessly to real-world scenarios, enabling robots to learn high-precision tasks in complex environments.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 61 of its 64 references that are in the map. First posted on arXiv 13 Jan 2026.

Builds on

61 of 64 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025BridgeVLA: Input-Output Alignment for Efficient 3D Manipulation Learning with Vision-Language Models9 Jun
  2. 2025PointVLA: Injecting the 3D World into Vision-Language-Action Models10 Mar
  3. 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control9 Feb
  4. 2024QUART-Online: Latency-Free Large Multimodal Language Model for Quadruped Robot Learning20 Dec
  5. 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
  6. 2024LLARVA: Vision-Action Instruction Tuning Enhances Robot Learning17 Jun
  7. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics15 Jun
  8. 2023Vision-Language Foundation Models as Effective Robot Imitators2 Nov
  9. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 52

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2025Qwen2.5-VL Technical Reportcited by 5,587
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  7. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  8. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  9. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  10. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  11. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  12. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
38 more
  1. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
  2. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  3. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
  4. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  5. 2024PaliGemma: A versatile 3B VLM for transfercited by 696
  6. 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 694
  7. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  8. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  9. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  10. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
  11. 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 523
  12. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  13. 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
  14. 2023An Embodied Generalist Agent in 3D Worldcited by 365
  15. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
  16. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
  17. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328
  18. 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
  19. 2022Masked Visual Pre-training for Motor Controlcited by 248
  20. 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 225
  21. 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 183
  22. 2023Act3D: 3D Feature Field Transformers for Multi-Task Robotic Manipulationcited by 138
  23. 2024RVT-2: Learning Precise Manipulation from Few Demonstrationscited by 137
  24. 2024THE COLOSSEUM: A Benchmark for Evaluating Generalization for Robotic Manipulationcited by 133
  25. 2024LLaVA-Phi: Efficient Multi-Modal Assistant with Small Language Modelcited by 129
  26. 2021Coarse-to-Fine Q-attention: Efficient Learning for Visual Robotic Manipulation via Discretisationcited by 122
  27. 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 113
  28. 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inferencecited by 97
  29. 2022Instruction-driven history-aware policies for robotic manipulationscited by 94
  30. 2024DistRL: An Asynchronous Distributed Reinforcement Learning Framework for On-Device Control Agentscited by 68
  31. 2023PolarNet: 3D Point Clouds for Language-Guided Robotic Manipulationcited by 56
  32. 2025VLAS: Vision-Language-Action Model With Speech Instructions For Customized Robot Manipulationcited by 51
  33. 2024Lift3D Foundation Policy: Lifting 2D Large-Scale Pretrained Models for Robust 3D Robotic Manipulationcited by 46
  34. 2025Humanoid-VLA: Towards Universal Humanoid Control with Visual Integrationcited by 45
  35. 2024Towards Generalizable Vision-Language Robotic Manipulation: A Benchmark and LLM-guided 3D Policycited by 38
  36. 2025FP3: A 3D Foundation Policy for Robotic Manipulationcited by 32
  37. 2025ReasonGrounder: LVLM-Guided Hierarchical Feature Splatting for Open-Vocabulary 3D Visual Grounding and Reasoningcited by 25
  38. 2024Mipha: A Comprehensive Overhaul of Multimodal Assistant with Small Language Modelscited by 24

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 18.

18 papers.

Sort:

By area:

  1. 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loopcited by 26
  2. 2026LIBERO-Occ: Evaluating and Improving Vision-Language-Action Models under Scene-Induced Occlusion via Viewpoint Imaginationcited by 3
  3. 2026WeaveLA: Event Driven Cross-Subtask Latent Memory Weaving for Repetitive Robot Manipulationcited by 2
  4. 2026LIME: Learning Intent-aware Camera Motion from Egocentric Videocited by 2
  5. 2026Thinking with Cameras: Active Visual Reasoning via Dynamic Viewpoint Control for Surveillance Video Understandingcited by 1
  6. 2026A3R: Agentic Affordance Reasoning via Cross-Dimensional Evidence in 3D Gaussian Scenescited by 0
  7. 2026VADF: Vision-Adaptive Diffusion Policy Framework for Efficient Robotic Manipulationcited by 0
  8. 2026CertVLA: Certified Defense against Physical Visual Attacks for Vision-Language-Action Modelscited by 0
  9. 2026GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulationcited by 0
  10. 2026INSPECT: Learning Robot View Selection from Assistant Usecited by 0
  11. 2026ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulationcited by 0
  12. 2026Beyond the Current Scene: Event-Referential Grasping with Active View Selectioncited by 0
6 more
  1. 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLAcited by 0
  2. 2026ROMA: LLM System for Real-World Object-Centric Multi-Sensory Active Perceptioncited by 0
  3. 2026RoboQuest: Generalist Physical Agents that Search, Inspect and Testcited by 0
  4. 2026VersaCamVLA: Camera-Configurable VLA Policies for Robotic Manipulationcited by 0
  5. 2026Fly-by-Code: Embodied Coding Agents for Aerial Manipulation with Active Visual and Physical Feedbackcited by 0
  6. 2026FoveaVLA: Foveation Actions Replace the Wrist Camera in VLAscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardware
  2. 20253D CAVLA: Leveraging Depth and 3D Context to Generalize Vision Language Action Models for Unseen Tasks
  3. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
  4. 2026SaPaVe: Towards Active Perception and Manipulation in Vision-Language-Action Models for Robotics
  5. 2026BridgeVLA++: A Data-Efficient, Generalizable, and Memory-Augmented Vision-Language-Action Framework for 3D Manipulation
  6. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
  7. 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulation
  8. 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review