From Passive Execution to Active Exploration: Agentic Embodied Manipulation in Realistic Environments
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Recent advances in agentic systems have substantially enhanced the long-horizon capability of embodied manipulation. However, many existing frameworks still follow a passive execution paradigm, which limits their applicability to real-world scenarios involving textual semantic cues, distractors, and initially invisible targets. To bridge this gap, we propose an agent-based active exploration framework that enables robots to dynamically interact with the environment rather than merely execute predefined instructions. Specifically, our framework consists of three collaborative modules: a planning module for high-level task reasoning, a perception module for visual scene understanding, and an execution module for low-level manipulation. This design allows the robot to actively acquire task-relevant information, adapt its behavior based on environmental feedback, and complete manipulation tasks under partial observability. Furthermore, we introduce a fine-grained perception-execution interleaving strategy, which tightly couples visual feedback with skill execution to improve exploration robustness. We evaluate our method on a realistic Find-and-Place task, demonstrating its effectiveness in challenging environments where target objects must be actively discovered before manipulation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 7 of its 8 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
7 of 8 references.
Closest ancestors · 2
Same direction, newest first
- 2026RoboClaw: An Agentic Framework for Scalable Long-Horizon Robotic Tasks12 Mar
- 2025Agentic Robot: A Brain-Inspired Framework for Vision-Language-Action Models in Embodied Agents29 May
Other references · 5
- 2024Language-Grounded Dynamic Scene Graphs for Interactive Object Search with Mobile Manipulationcited by 70
- 2023Learning Hierarchical Interactive Multi-Object Search for Mobile Manipulationcited by 14
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoningcited by 6
- 2026SaiVLA-0: Cerebrum--Pons--Cerebellum Tripartite Architecture for Compute-Aware Vision-Language-Actioncited by 5
- 2025RoboRetriever: Single-Camera Robot Object Retrieval via Active and Interactive Perception with Dynamic Scene Graphcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Exploratory, Communicative, and Deployable: Vision-Driven Embodied Agents for Open-World Mobile Manipulation
- 2025P3: Toward Versatile Embodied Agents
- 2026CodeActionBench: Evaluating Agentic Code-as-Policy for Embodied Manipulation
- 2026PhysCaP: Grounding Code-as-Policy Agent with Physics-Informed Exploration
- 2026RoboQuest: Generalist Physical Agents that Search, Inspect and Test
- 2026ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulation
- 2026Cortex: A Bidirectionally Aligned Embodied Agent Framework for Long-horizon Manipulation
- 2025RoboSeek: You Need to Interact with Your Objects