mlsanityData to 14 Oct 2026

Zero-shot adaptable task planning for autonomous construction robots: a comparative study of lightweight single and multi-AI agent systems

arXiv 2601.14091 ↗First posted 20 Jan 2026cs.RO cs.AIcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Robots are expected to play a major role in the future construction industry but face challenges due to high costs and difficulty adapting to dynamic tasks. This study explores the potential of foundation models to enhance the adaptability and generalizability of task planning in construction robots. Four models are proposed and implemented using lightweight, open-source large language models (LLMs) and vision language models (VLMs). These models include one single agent and three multi-agent teams that collaborate to create robot action plans. The models are evaluated across three construction roles: Painter, Safety Inspector, and Floor Tiling. Results show that the four-agent team outperforms the state-of-the-art GPT-4o in most metrics while being ten times more cost-effective. Additionally, teams with three and four agents demonstrate the improved generalizability. By discussing how agent behaviors influence outputs, this study enhances the understanding of AI teams and supports future research in diverse unstructured environments beyond construction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 41 of its 107 references that are in the map. First posted on arXiv 20 Jan 2026.

Builds on

41 of 107 references.

Closest ancestors · 2

Same direction, newest first

  1. 2023SMART-LLM: Smart Multi-Agent Robot Task Planning using Large Language Models18 Sep
  2. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 39

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  7. 2023Visual Instruction Tuningcited by 7,869
  8. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  9. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  10. 2023Mistral 7Bcited by 3,164
  11. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  12. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
27 more
  1. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  2. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  3. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  4. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  5. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
  6. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
  7. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
  8. 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 216
  9. 2023Efficient Large Language Models: A Surveycited by 186
  10. 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 95
  11. 2024Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Modelscited by 84
  12. 2022Can Foundation Models Perform Zero-Shot Task Specification For Robot Manipulation?cited by 70
  13. 2023Are Large Language Models Really Good Logical Reasoners? A Comprehensive Evaluation and Beyondcited by 65
  14. 2018Task Planning in Robotics: an Empirical Comparison of PDDL-based and ASP-based Systemscited by 40
  15. 2023RobotGPT: Robot Manipulation Learning from ChatGPTcited by 39
  16. 2023Robot Learning in the Era of Foundation Models: A Surveycited by 38
  17. 2023Large Language Models as Zero-Shot Human Models for Human-Robot Interactioncited by 30
  18. 2024LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language Modelscited by 29
  19. 2024SPARTUN3D: Situated Spatial Understanding of 3D World in Large Language Modelscited by 27
  20. 2022Fine-Tuning Pre-Trained Language Models Effectively by Optimizing Subnetworks Adaptivelycited by 18
  21. 2023Improved Trust in Human-Robot Collaboration with ChatGPTcited by 18
  22. 2024LLM-based Robot Task Planning with Exceptional Handling for General Purpose Service Robotscited by 16
  23. 2023AutoPlan: Automatic Planning of Interactive Decision-Making Tasks With Large Language Modelscited by 13
  24. 2022Differentiable Constrained Imitation Learning for Robot Motion Planning and Controlcited by 7
  25. 2023Dynamic Stashing Quantization for Efficient Transformer Trainingcited by 6
  26. 2024Foundation Models for Autonomous Robots in Unstructured Environmentscited by 3
  27. 2023Enabling Building Information Model-Driven Human-Robot Collaborative Construction Workflows with Closed-Loop Digital Twinscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Hybrid LLM-based Intelligent Framework for Robot Task Scheduling
  2. 2025Phase-Adaptive LLM Framework with Multi-Stage Validation for Construction Robot Task Allocation: A Systematic Benchmark Against Traditional Optimization Algorithms
  3. 2026Task-Aware Positioning for Improvisational Tasks in Mobile Construction Robots via an AI Agent with Multi-LMM Modules ↗
  4. 2025Integrating LLMs and Digital Twins for Adaptive Multi-Robot Task Allocation in Construction
  5. 2026A Taxonomy of Construction Task Activities for Robot Workers ↗
  6. 2025Sample-Efficient Robot Skill Learning for Construction Tasks: Benchmarking Hierarchical Reinforcement Learning and Vision-Language-Action VLA Model
  7. 2023Robot-Enabled Construction Assembly with Automated Sequence Planning based on ChatGPT: RoboGPT
  8. 2025Investigating the Potential of Large Language Model-Based Router Multi-Agent Architectures for Foundation Design Automation: A Task Classification and Expert Selection Study