Plan Right, Then Plan Tight: Symbolic RL for Efficient Embodied Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Embodied task planning asks an agent to turn a natural-language instruction into an executable sequence of actions in a physical scene, and is a building block for household, assistive, and service robots. Recent prompting-based and reinforcement-learning planners generate fluent action text but lack a cheap deterministic check that the produced plan is valid in the target world, while high-fidelity simulation is too slow to serve as an inner-loop training signal. The general problem is therefore how to obtain verifiable supervision and rewards for embodied planners without relying on string-level matching or full simulation. Here we show that a single BDDL specification, automatically constructed from open-world video evidence or curated tasks, can serve as a shared interface for data construction, plan verification, and reward design. A video-to-BDDL parser, an LLM verifier, and a lightweight symbolic engine together supply dense feedback at millisecond latency. We further introduce GroupAdapt, a difficulty-aware length schedule that uses the in-batch group pass rate as a zero-cost signal so that hard prompts get wider length tolerance and automatically tighten as their pass rate improves. Under the guidance of the proposed verifier and GroupAdapt schedule, the 8B planner attains a Strict-Pass score of 97.3 on BEHAVIOR-1000, yielding a 25.9 percent relative improvement over the Qwen3-8B baseline. This result exceeds the strongest large-model baseline by 3.5 percent, while simultaneously compressing the response length by 79 percent to 207 tokens, demonstrating both effectiveness and efficiency.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 40 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
18 of 40 references.
References · 18
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
6 more
- 2025L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learningcited by 381
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
- 2025Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Searchcited by 53
- 2025Shorten After You're Right: Lazy Length Penalties for Reasoning RLcited by 25
- 2025DeepCompress: A Dual Reward Strategy for Dynamically Exploring and Compressing Reasoning Chainscited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026RoboAgent: Chaining Basic Capabilities for Embodied Task Planning
- 2025Plan Verification for LLM-Based Embodied Task Completion Agents
- 2026X-Planner: Event-Structured Task Planning for Embodied Intelligence
- 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought
- 2025Constrained Natural Language Action Planning for Resilient Embodied Systems
- 2025Reinforced Embodied Planning with Verifiable Reward for Real-World Robotic Manipulation
- 2025Reinforced Reasoning for Embodied Planning
- 2026Embodied Task Planning via Graph-Informed Action Generation with Large Language Models