AnywhereVLA: Language-Conditioned Exploration and Mobile Manipulation
Not on the map. Why?
Abstract (arXiv)
We address natural language pick-and-place in unseen, unpredictable indoor environments with AnywhereVLA, a modular framework for mobile manipulation. A user text prompt serves as an entry point and is parsed into a structured task graph that conditions classical SLAM with LiDAR and cameras, metric semantic mapping, and a task-aware frontier exploration policy. An approach planner then selects visibility and reachability aware pre grasp base poses. For interaction, a compact SmolVLA manipulation head is fine tuned on platform pick and place trajectories for the SO-101 by TheRobotStudio, grounding local visual context and sub-goals into grasp and place proposals. The full system runs fully onboard on consumer-level hardware, with Jetson Orin NX for perception and VLA and an Intel NUC for SLAM, exploration, and control, sustaining real-time operation. We evaluated AnywhereVLA in a multi-room lab under static scenes and normal human motion. In this setting, the system achieves a 46% overall task success rate while maintaining throughput on embedded compute. By combining a classical stack with a fine-tuned VLA manipulation, the system inherits the reliability of geometry-based navigation with the agility and task generalization of language-conditioned manipulation.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 22 of its 29 references that are in the map. First posted on arXiv 25 Sep 2025.
Builds on
22 of 29 references.
References · 22
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2018A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillationcited by 110
- 2020The Marathon 2: A Navigation Systemcited by 70
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2024FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometrycited by 44
- 2023ASC: Adaptive Skill Coordination for Robotic Mobile Manipulationcited by 42
10 more
- 2025MoManipVLA: Transferring Vision-language-action Models for General Mobile Manipulationcited by 34
- 2024BUMBLE: Unifying Reasoning and Acting with Vision-Language Models for Building-wide Mobile Manipulationcited by 32
- 2025AC-DiT: Adaptive Coordination Diffusion Transformer for Mobile Manipulationcited by 23
- 2024TidyBot++: An Open-Source Holonomic Mobile Manipulator for Robot Learningcited by 22
- 2025EdgeVLA: Efficient Vision-Language-Action Modelscited by 19
- 2024Demonstrating Mobile Manipulation in the Wild: A Metrics-Driven Approachcited by 11
- 2023Natural Language Instructions for Intuitive Human Interaction with Robotic Assistants in Field Construction Workcited by 3
- 2023TacMMs: Tactile Mobile Manipulators for Warehouse Automationcited by 2
- 2025Practical Insights on Grasp Strategies for Mobile Manipulation in the Wildcited by 1
- 2025Language-Guided Long Horizon Manipulation with LLM-based Planning and Visual Perceptioncited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulationcited by 15
- 2026Exploration and Exploitation Errors Are Measurable for Language Model Agentscited by 3
- 2026LiteVLA-H: Dual-Rate Vision-Language-Action Inference for Onboard Aerial Guidance and Semantic Perceptioncited by 0
- 2026LiteVLA-H: Dual-Rate Vision-Language-Action Inference for Onboard Aerial Guidance and Semantic Perception27 Apr 2026
- 2026Exploration and Exploitation Errors Are Measurable for Language Model Agents14 Apr 2026
- 2025EchoVLA: Robotic Vision-Language-Action Model with Synergistic Declarative Memory for Mobile Manipulation22 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026SpaceVLA: Spatially Grounded VLA for Robotic Manipulation with User-Authored Grasp and Place Anchors
- 2026GloVLA: Let Geometry Move and Local VLA Interact for Robust Object-Centric Manipulation in Unstructured Environments
- 2026OneVLA: A Unified Framework for Embodied Tasks
- 2025Affordance-Guided Coarse-to-Fine Exploration for Base Placement in Open-Vocabulary Mobile Manipulation
- 2026UniPlan: Vision-Language Task Planning for Mobile Manipulation with Unified PDDL Formulation
- 2026RMMBench: A Comprehensive Benchmark for Robotic Mobile Manipulation
- 2026Make Your VLA More Robust Without More Data By Interleaving Motion Planning
- 2026SG-VLA: Learning Spatially-Grounded Vision-Language-Action Models for Mobile Manipulation