LLM-BRAIn: AI-driven Fast Generation of Robot Behaviour Tree based on Large Language Model
Not on the map. Why?
Abstract (arXiv)
This paper presents a novel approach in autonomous robot control, named LLM-BRAIn, that makes possible robot behavior generation, based on operator's commands. LLM-BRAIn is a transformer-based Large Language Model (LLM) fine-tuned from Stanford Alpaca 7B model to generate robot behavior tree (BT) from the text description. We train the LLM-BRAIn on 8,5k instruction-following demonstrations, generated in the style of self-instruct using text-davinchi-003. The developed model accurately builds complex robot behavior while remaining small enough to be run on the robot's onboard microcomputer. The model gives structural and logical correct BTs and can successfully manage instructions that were not presented in training set. The experiment did not reveal any significant subjective differences between BTs generated by LLM-BRAIn and those created by humans (on average, participants were able to correctly distinguish between LLM-BRAIn generated BTs and human-created BTs in only 4.53 out of 10 cases, indicating that their performance was close to random chance). The proposed approach potentially can be applied to mobile robotics, drone operation, robot manipulator systems and Industry 4.0.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 May 2023.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 2; 2024: 11; 2025: 4; 2026: 6.
23 papers.
Sort:
By area:
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2025Text2Scenario: Text-Driven Scenario Generation for Autonomous Driving Testcited by 18
- 2024Integrating Intent Understanding and Optimal Behavior Planning for Behavior Tree Generation from Human Instructionscited by 12
- 2024Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memorycited by 6
- 2024Industry 6.0: New Generation of Industry driven by Generative AI and Swarm of Heterogeneous Robotscited by 5
- 2023LLM-SAP: Large Language Models Situational Awareness Based Planningcited by 4
- 2024A Study on Training and Developing Large Language Models for Behavior Tree Generationcited by 4
- 2024Designing Robust Cyber-Defense Agents with Evolving Behavior Treescited by 4
- 2024LLMSat: A Large Language Model-Based Goal-Oriented Agent for Autonomous Space Explorationcited by 3
- 2024HBTP: Heuristic Behavior Tree Planning with Large Language Model Reasoningcited by 3
- 2024Integrating Large Language Models for UAV Control in Simulated Environments: A Modular Interaction Approachcited by 3
- 2024The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcarecited by 2
11 more
- 2026Multimodal Behavior Tree Generation: A Small Vision-Language Model for Robot Task Planningcited by 2
- 2024AUTONODE: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automationcited by 1
- 2025Exploring GPT-4 for Robotic Agent Strategy with Real-Time State Feedback and a Reactive Behaviour Frameworkcited by 1
- 2024Behavior Trees Enable Structured Programming of Language Model Agentscited by 0
- 2025Interpretable Robot Control via Structured Behavior Trees and Large Language Modelscited by 0
- 2025Robot guide with multi-agent control and automatic scenario generation with LLMcited by 0
- 2026Learning Structured Robot Policies from Vision-Language Models via Synthetic Neuro-Symbolic Supervisioncited by 0
- 2026Contract-Grounded Behavior Tree Synthesis via Coding Agentscited by 0
- 2026Mamba-based Selective State Space Modeling Improves the Accuracy-Complexity Tradeoff of SmolVLA Vision-Language-Action Expertscited by 0
- 2026ORDER: A Fictitious-World Benchmark for Domain-Adaptive Embodied AIcited by 0
- 2026Towards An LLM-Driven Unified Conversion Framework for BT and FSM in Autonomous Intelligent Systemscited by 0
- 2026Towards An LLM-Driven Unified Conversion Framework for BT and FSM in Autonomous Intelligent Systems24 Sep 2026
- 2026ORDER: A Fictitious-World Benchmark for Domain-Adaptive Embodied AI13 Sep 2026
- 2026Mamba-based Selective State Space Modeling Improves the Accuracy-Complexity Tradeoff of SmolVLA Vision-Language-Action Experts10 Aug 2026
- 2026Contract-Grounded Behavior Tree Synthesis via Coding Agents13 Jul 2026
- 2026Learning Structured Robot Policies from Vision-Language Models via Synthetic Neuro-Symbolic Supervision3 Apr 2026
- 2026Multimodal Behavior Tree Generation: A Small Vision-Language Model for Robot Task Planning6 Mar 2026
- 2025Robot guide with multi-agent control and automatic scenario generation with LLM12 Sep 2025
- 2025Interpretable Robot Control via Structured Behavior Trees and Large Language Models13 Aug 2025
- 2025Exploring GPT-4 for Robotic Agent Strategy with Real-Time State Feedback and a Reactive Behaviour Framework30 Mar 2025
- 2025Text2Scenario: Text-Driven Scenario Generation for Autonomous Driving Test4 Mar 2025
- 2024The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcare5 Nov 2024
- 2024Integrating Large Language Models for UAV Control in Simulated Environments: A Modular Interaction Approach23 Oct 2024
11 more
- 2024Designing Robust Cyber-Defense Agents with Evolving Behavior Trees21 Oct 2024
- 2024Industry 6.0: New Generation of Industry driven by Generative AI and Swarm of Heterogeneous Robots16 Sep 2024
- 2024HBTP: Heuristic Behavior Tree Planning with Large Language Model Reasoning3 Jun 2024
- 2024Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memory30 May 2024
- 2024Integrating Intent Understanding and Optimal Behavior Planning for Behavior Tree Generation from Human Instructions13 May 2024
- 2024LLMSat: A Large Language Model-Based Goal-Oriented Agent for Autonomous Space Exploration13 Apr 2024
- 2024Behavior Trees Enable Structured Programming of Language Model Agents11 Apr 2024
- 2024AUTONODE: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automation15 Mar 2024
- 2024A Study on Training and Developing Large Language Models for Behavior Tree Generation16 Jan 2024
- 2023LLM-SAP: Large Language Models Situational Awareness Based Planning26 Dec 2023
- 2023A Comprehensive Overview of Large Language Models12 Jul 2023
- 2024LLMSat: A Large Language Model-Based Goal-Oriented Agent for Autonomous Space Explorationcited by 3
- 2025Exploring GPT-4 for Robotic Agent Strategy with Real-Time State Feedback and a Reactive Behaviour Frameworkcited by 1
- 2024Behavior Trees Enable Structured Programming of Language Model Agentscited by 0
- 2025Robot guide with multi-agent control and automatic scenario generation with LLMcited by 0
- 2026Contract-Grounded Behavior Tree Synthesis via Coding Agentscited by 0
- 2026Contract-Grounded Behavior Tree Synthesis via Coding Agents13 Jul 2026
- 2025Robot guide with multi-agent control and automatic scenario generation with LLM12 Sep 2025
- 2025Exploring GPT-4 for Robotic Agent Strategy with Real-Time State Feedback and a Reactive Behaviour Framework30 Mar 2025
- 2024LLMSat: A Large Language Model-Based Goal-Oriented Agent for Autonomous Space Exploration13 Apr 2024
- 2024Behavior Trees Enable Structured Programming of Language Model Agents11 Apr 2024
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2024Integrating Intent Understanding and Optimal Behavior Planning for Behavior Tree Generation from Human Instructionscited by 12
- 2024Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memorycited by 6
- 2024Industry 6.0: New Generation of Industry driven by Generative AI and Swarm of Heterogeneous Robotscited by 5
- 2023LLM-SAP: Large Language Models Situational Awareness Based Planningcited by 4
- 2024A Study on Training and Developing Large Language Models for Behavior Tree Generationcited by 4
- 2024Designing Robust Cyber-Defense Agents with Evolving Behavior Treescited by 4
- 2024Integrating Large Language Models for UAV Control in Simulated Environments: A Modular Interaction Approachcited by 3
- 2024The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcarecited by 2
- 2024AUTONODE: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automationcited by 1
- 2025Interpretable Robot Control via Structured Behavior Trees and Large Language Modelscited by 0
- 2026ORDER: A Fictitious-World Benchmark for Domain-Adaptive Embodied AIcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Towards An LLM-Driven Unified Conversion Framework for BT and FSM in Autonomous Intelligent Systems24 Sep 2026
- 2026ORDER: A Fictitious-World Benchmark for Domain-Adaptive Embodied AI13 Sep 2026
- 2025Interpretable Robot Control via Structured Behavior Trees and Large Language Models13 Aug 2025
- 2024The Future of Intelligent Healthcare: A Systematic Analysis and Discussion on the Integration and Impact of Robots Using Large Language Models for Healthcare5 Nov 2024
- 2024Integrating Large Language Models for UAV Control in Simulated Environments: A Modular Interaction Approach23 Oct 2024
- 2024Designing Robust Cyber-Defense Agents with Evolving Behavior Trees21 Oct 2024
- 2024Industry 6.0: New Generation of Industry driven by Generative AI and Swarm of Heterogeneous Robots16 Sep 2024
- 2024Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memory30 May 2024
- 2024Integrating Intent Understanding and Optimal Behavior Planning for Behavior Tree Generation from Human Instructions13 May 2024
- 2024AUTONODE: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automation15 Mar 2024
- 2024A Study on Training and Developing Large Language Models for Behavior Tree Generation16 Jan 2024
- 2023LLM-SAP: Large Language Models Situational Awareness Based Planning26 Dec 2023
12 newest of 13 All 13 (JSON)