Zero-shot adaptable task planning for autonomous construction robots: a comparative study of lightweight single and multi-AI agent systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Robots are expected to play a major role in the future construction industry but face challenges due to high costs and difficulty adapting to dynamic tasks. This study explores the potential of foundation models to enhance the adaptability and generalizability of task planning in construction robots. Four models are proposed and implemented using lightweight, open-source large language models (LLMs) and vision language models (VLMs). These models include one single agent and three multi-agent teams that collaborate to create robot action plans. The models are evaluated across three construction roles: Painter, Safety Inspector, and Floor Tiling. Results show that the four-agent team outperforms the state-of-the-art GPT-4o in most metrics while being ten times more cost-effective. Additionally, teams with three and four agents demonstrate the improved generalizability. By discussing how agent behaviors influence outputs, this study enhances the understanding of AI teams and supports future research in diverse unstructured environments beyond construction.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 41 of its 107 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
41 of 107 references.
Closest ancestors · 2
Same direction, newest first
- 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models18 Sep
- 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar
Other references · 39
- 2017Attention Is All You Needcited by 60,361
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Visual Instruction Tuningcited by 7,869
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2023Mistral 7Bcited by 3,164
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
27 more
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 216
- 2023Efficient Large Language Models: A Surveycited by 186
- 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 95
- 2024Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Modelscited by 84
- 2022Can Foundation Models Perform Zero-Shot Task Specification For Robot Manipulation?cited by 70
- 2023Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyondcited by 65
- 2018Task Planning in Robotics: an Empirical Comparison of PDDL-based and ASP-based Systemscited by 40
- 2023RobotGPT: Robot Manipulation Learning from ChatGPTcited by 39
- 2023Robot Learning in the Era of Foundation Models: A Surveycited by 38
- 2023Large Language Models as Zero-Shot Human Models for Human-Robot Interactioncited by 30
- 2024LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language Modelscited by 29
- 2024SPARTUN3D: Situated Spatial Understanding of 3D World in Large Language Modelscited by 27
- 2022Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptivelycited by 18
- 2023Improved Trust in Human-Robot Collaboration with ChatGPTcited by 18
- 2024LLM-based Robot Task Planning with Exceptional Handling for General Purpose Service Robotscited by 16
- 2023AutoPlan: Automatic Planning of Interactive Decision-Making Tasks With Large Language Modelscited by 13
- 2022Differentiable Constrained Imitation Learning for Robot Motion Planning and Controlcited by 7
- 2023Dynamic Stashing Quantization for Efficient Transformer Trainingcited by 6
- 2024Foundation Models for Autonomous Robots in Unstructured Environmentscited by 3
- 2023Enabling Building Information Model-Driven Human-Robot Collaborative Construction Workflows with Closed-Loop Digital Twinscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Hybrid LLM-based Intelligent Framework for Robot Task Scheduling
- 2025Phase-Adaptive LLM Framework with Multi-Stage Validation for Construction Robot Task Allocation: A Systematic Benchmark Against Traditional Optimization Algorithms
- 2026Task-Aware Positioning for Improvisational Tasks in Mobile Construction Robots via an AI Agent with Multi-LMM Modules ↗
- 2025Integrating LLMs and Digital Twins for Adaptive Multi-Robot Task Allocation in Construction
- 2026A Taxonomy of Construction Task Activities for Robot Workers ↗
- 2025Sample-Efficient Robot Skill Learning for Construction Tasks: Benchmarking Hierarchical Reinforcement Learning and Vision-Language-Action VLA Model
- 2023Robot-Enabled Construction Assembly with Automated Sequence Planning based on ChatGPT: RoboGPT
- 2025Investigating the Potential of Large Language Model-Based Router Multi-Agent Architectures for Foundation Design Automation: A Task Classification and Expert Selection Study