Embodied Agents Take Control: Minimal-Interface Zero-Shot Agents Rival Industrial-Scale Policies in Vision-and-Language Navigation
Not on the map. Why?
Abstract (arXiv)
Autonomous embodied agents must sustain a long decision-making loop that involves perceiving, acting, verifying, and self-correcting over many steps. Current systems sustain this loop through task-specific workflows or embodied policies. However, these fixed workflows and policies offer limited flexibility across environments and often lack effective recovery strategies when execution goes wrong. We find that a general-purpose agent can instead sustain the loop on its own. We term this organization agentic embodied control: the reasoning model directly steers every action, keeping reasoning and control aligned. Using zero-shot navigation as a controlled testbed, we equip three coding-agent harnesses with only a monocular RGB camera and discrete actions. At default effort, replicated opus-5 runs average 70.7±3.5% success, while fable-5 reaches 78% at maximum effort. When a trained waypoint tool is offered alongside primitives, the hybrid fable-5 agent reaches 76.7±0.6% at default effort, using half the environment steps and under a quarter of the wall time. Across the ablations, model choice dominates performance variation. Observed harness differences are modest, and forced waypoints help weaker models but can hinder stronger ones. Although longer horizons, latency, and context growth remain barriers to sustained autonomy, these results show that a general-purpose model can already achieve competitive embodied control without a navigation policy.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Jul 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Show-Harness: Just a VLM Agent Can Play Robotscited by 17
- 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harnesscited by 3
- 2026NavHarness: Adaptive Goals for Agentic Vision-Language Navigationcited by 0
- 2026NavGPT-3: Harnessing Context in a Hierarchical Navigation Runtimecited by 0
- 2026NavGPT-3: Harnessing Context in a Hierarchical Navigation Runtime7 Oct 2026
- 2026NavHarness: Adaptive Goals for Agentic Vision-Language Navigation30 Sep 2026
- 2026HarnessVLN: Unifying Training-Free Embodied Navigation through an Agent Harness14 Sep 2026
- 2026Show-Harness: Just a VLM Agent Can Play Robots9 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026ASENA: Self-evolving Agents for Embodied Navigation
- 2026Towards the Harness of Embodied Agents
- 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence
- 2026Global Commander and Local Operative: A Dual-Agent Framework for Scene Navigation
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory
- 2025Embodied4C: Measuring What Matters for Embodied Vision-Language Navigation
- 2026Zetta zeta: An Efficient Closed-Loop Embodied Harness for Self-Evolving Physical Intelligence
- 2026ABot-Claw: A Foundation for Persistent, Cooperative, and Self-Evolving Robotic Agents