Agentic Neuro-Symbolic Planning and Commissioning for Human-in-the-Loop Industrial Robotics with Digital Twins
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Flexible robotic automation requires systems that interpret operator intent, verify physical feasibility, and recover from execution failures across both the planning and execution stages. This paper proposes an agentic neuro-symbolic framework for human-in-the-loop industrial robotics, in which LLMs are used for tasks that require language understanding or contextual reasoning, while all verification, sequencing, and execution remain deterministic. The framework adapts the Planner-Generator-Evaluator (PGE) harness pattern from software engineering into a Specifier-Designer-Inspector (SDI) architecture for industrial robotics, combined with LangGraph-based dynamic routing for failure recovery. A two-tier recovery mechanism addresses structure-level replanning through context-aware orchestration and execution-level geometric failures through deterministic recovery skills. A Unity3D digital twin supports human inspection, modification, and re-verification prior to physical execution. Evaluated on natural-language commands across multiple difficulty levels against ten baselines, the proposed method achieves the highest task success. Ablation results confirm that structured command expansion, symbolic verification, selective LLM routing, and recovery skills are each individually necessary.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 27 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
9 of 27 references.
References · 9
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2020Integrated Task and Motion Planningcited by 290
- 2023A Framework for Neurosymbolic Robot Action Planning using Large Language Modelscited by 12
- 2025Building Intelligent Agents with Neuro-Symbolic Conceptscited by 10
- 2024Industry 6.0: New Generation of Industry driven by Generative AI and Swarm of Heterogeneous Robotscited by 5
- 2025Achieving Scalable Robot Autonomy via neurosymbolic planning using lightweight local LLMcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Agentic Robot: A Brain-Inspired Framework for Vision-Language-Action Models in Embodied Agents
- 2025LOOP: A Plug-and-Play Neuro-Symbolic Framework for Enhancing Planning in Autonomous Systems
- 2026DUPLEX: Agentic Dual-System Planning via LLM-Driven Information Extraction
- 2025Constrained Natural Language Action Planning for Resilient Embodied Systems
- 2026Verification-Gated Agentic Mission-State Governance for Intelligent Industrial Multi-Robot Systems
- 2025Autonomous Control Leveraging LLMs: An Agentic Framework for Next-Generation Industrial Automation
- 2026From Reaction to Anticipation: Proactive Failure Recovery through Agentic Task Graph for Robotic Manipulation
- 2026Agentic AI-enabled Semantic Commissioning of a Cognitive Digital Twin for Reconfigurable Manufacturing