Fewer Tokens, Better Action: GPT-6 Astra Robot Agents with 14% Higher Success Rate but 65% Fewer Tokens
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 1 more
Abstract (arXiv)
Vision language model (VLM) agents can control robots through visual feedback and action primitives, but repeated model invocations and redundant observations incur substantial token overhead. We introduce PyRUA-Lean, an interactive code-execution framework that couples feedback-driven primitive composition with selective observation: the agent composes classical robot primitives and learned vision-language-action (VLA) policies into Python cells that perform conditional checks and local retries, returning only explicitly requested images and state feedback for replanning. Across 700 simulated task instances from LIBERO-PRO, RoboTwin 2.0, and RoboCasa365, we compare PyRUA-Lean with a tool-calling baseline using the same GPT-6 Astra planner and underlying robot primitives. Under equal LLM-call budgets, PyRUA-Lean increases overall success from 63.1% to 71.7%. On instances solved by both agents, it uses 49% fewer LLM calls and 65% fewer input tokens.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 27 of its 33 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
27 of 33 references.
Closest ancestors · 3
Same direction, newest first
- 2026Show-Harness: Just a VLM Agent Can Play Robots9 Sep
- 2026VLCP: Vision Language Control Policy Closed-Loop Code Replanning for Robot Manipulation17 Aug
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 24
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2025SAM 3: Segment Anything with Conceptscited by 835
12 more
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2024Executable Code Actions Elicit Better LLM Agentscited by 537
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
- 2026A Pragmatic VLA Foundation Modelcited by 97
- 2026CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulationcited by 72
- 2026RoboCasa365: A Large-Scale Simulation Framework for Training and Benchmarking Generalist Robotscited by 65
- 2026ASPIRE: Agentic /Skills Discovery for Roboticscited by 44
- 2026Harness VLA: Steering Frozen VLAs into Reliable Manipulation Primitives via Memory-Guided Agentscited by 37
- 2026RoboDojo: A Unified Sim-and-Real Benchmark for Comprehensive Evaluation of Generalist Robot Manipulation Policiescited by 35
- 2026RLDX-1 Technical Reportcited by 25
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026StarVLA-α: Reducing Complexity in Vision-Language-Action Systems
- 2025Robot Control Stack: A Lean Ecosystem for Robot Learning at Scale
- 2026EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents
- 2025From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models
- 2026Benchmarking Vision-Language-Action Models on SO-101: Failure and Recovery Analysis
- 2026CoRE-VLA: Towards Scalable and Robust Vision-Language-Action Modeling via Conditional Routing of Experts
- 2026Faster and Better? Benchmark Bugs and Design Limitations Distort the Evaluation of Vision-Language-Action Acceleration
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges