mlsanityData to 7 Oct 2026

REFLEX: Metacognitive Reasoning for Reflective Zero-Shot Robotic Planning with Large Language Models

arXiv 2505.14899 ↗First posted 20 May 2025cs.RO cs.CLcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

While large language models (LLMs) have shown great potential across various domains, their applications in robotics remain largely limited to static prompt-based behaviors and still face challenges in complex tasks under zero-shot or few-shot settings. Inspired by human metacognitive learning and creative problem-solving, we address this limitation by exploring a fundamental question: Can LLMs be empowered with metacognitive capabilities to reason, reflect, and create, thereby enhancing their ability to perform robotic tasks with minimal demonstrations? In this paper, we present REFLEX, a framework that integrates metacognitive learning into LLM-powered multi-robot collaboration. The system equips the LLM-powered robotic agents with a skill decomposition and self-reflection mechanism that identifies modular skills from prior tasks, reflects on failures in unseen task scenarios, and synthesizes effective new solutions. We propose a more challenging robotic benchmark task and evaluate our framework on the existing benchmark and the novel task. Experimental results show that our metacognitive learning framework significantly outperforms existing baselines. Moreover, we observe that our framework can generate solutions that differ from the ground truth yet still successfully complete the tasks. These findings support our hypothesis that metacognitive learning can foster creativity in robotic planning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 22 references that are in the map. First posted on arXiv 20 May 2025.

Builds on

18 of 22 references.

References · 18

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  3. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  4. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  5. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  6. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
  7. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 289
  8. 2023RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulationcited by 206
  9. 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 171
  10. 2023AutoTAMP: Autoregressive Task and Motion Planning with LLMs as Translators and Checkerscited by 111
  11. 2023A Confederacy of Models: a Comprehensive Evaluation of LLMs on Creative Writingcited by 98
  12. 2024Large Language Models for Robotics: Opportunities, Challenges, and Perspectivescited by 88
6 more
  1. 2023RobotGPT: Robot Manipulation Learning from ChatGPTcited by 39
  2. 2024Enhancing the LLM-Based Robot Manipulation Through Human-Robot Collaborationcited by 19
  3. 2024Empowering Large Language Models on Robotic Manipulation with Affordance Promptingcited by 17
  4. 2025RoboHorizon: An LLM-Assisted Multi-View World Model for Long-Horizon Robotic Manipulationcited by 17
  5. 2024Language-Augmented Symbolic Planner for Open-World Task Planningcited by 8
  6. 2025VIPER: Visual Perception and Explainable Reasoning for Sequential Decision-Makingcited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Mind to Hand: Purposeful Robotic Control via Embodied Reasoning
  2. 2025Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulation
  3. 2025Think, Act, Learn: A Framework for Autonomous Robotic Agents using Closed-Loop Large Language Models
  4. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulation
  5. 2025MaP-AVR: A Meta-Action Planner for Agents Leveraging Vision Language Models and Retrieval-Augmented Generation
  6. 2025A Pragmatist Robot: Learning to Plan Tasks by Experiencing the Real World
  7. 2024MALMM: Multi-Agent Large Language Models for Zero-Shot Robotics Manipulation
  8. 2024Agentic Skill Discovery