mlsanityData to 14 Oct 2026

Controlling Large Language Model-based Agents for Large-Scale Decision-Making: An Actor-Critic Approach

arXiv 2311.13884 ↗First posted 23 Nov 2023cs.AIcited by 38

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

The remarkable progress in Large Language Models (LLMs) opens up new avenues for addressing planning and decision-making problems in Multi-Agent Systems (MAS). However, as the number of agents increases, the issues of hallucination in LLMs and coordination in MAS have become increasingly prominent. Additionally, the efficient utilization of tokens emerges as a critical consideration when employing LLMs to facilitate the interactions among a substantial number of agents. In this paper, we develop a modular framework called LLaMAC to mitigate these challenges. LLaMAC implements a value distribution encoding similar to that found in the human brain, utilizing internal and external feedback mechanisms to facilitate collaboration and iterative reasoning among its modules. Through evaluations involving system resource allocation and robot grid transportation, we demonstrate the considerable advantages afforded by our proposed approach.

Key facts. Cited by 38 papers in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 36 of its 52 references that are in the map. First posted on arXiv 23 Nov 2023.

Builds on

36 of 52 references.

Closest ancestors · 6

Same direction, newest first

  1. 2023TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Systems19 Nov
  2. 2023AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors21 Aug
  3. 2023ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate14 Aug
  4. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  5. 2023Building Cooperative Embodied Agents Modularly with Large Language Models5 Jul
  6. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society31 Mar

Other references · 30

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  3. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  4. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  5. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  6. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
  7. 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
  8. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
  9. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
  10. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  11. 2023Reasoning with Language Model is Planning with World Modelcited by 861
  12. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 698
18 more
  1. 2019Multi-Agent Reinforcement Learning: A Selective Overview of Theories and Algorithmscited by 567
  2. 2020Monotonic Value Function Factorisation for Deep Multi-Agent Reinforcement Learningcited by 485
  3. 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
  4. 2022Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoningcited by 334
  5. 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 297
  6. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 289
  7. 2023Exploring Large Language Models for Communication Games: An Empirical Study on Werewolfcited by 241
  8. 2021Trust Region Policy Optimisation in Multi-Agent Reinforcement Learningcited by 186
  9. 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 172
  10. 2023Scalable Multi-Robot Collaboration with Large Language Models: Centralized or Decentralized Systems?cited by 106
  11. 2023Avalon's Game of Thoughts: Battle Against Deception through Recursive Contemplationcited by 104
  12. 2020Game-Theoretic Multiagent Reinforcement Learningcited by 94
  13. 2023MindAgent: Emergent Gaming Interactioncited by 88
  14. 2023Is ChatGPT the Ultimate Programming Assistant -- How far is it?cited by 76
  15. 2022Consensus Learning for Cooperative Multi-Agent Reinforcement Learningcited by 8
  16. 2023Inducing Stackelberg Equilibrium through Spatio-Temporal Sequential Decision-Making in Multi-Agent Reinforcement Learningcited by 5
  17. 2022Efficient Policy Generation in Multi-Agent Systems via Hypergraph Neural Networkcited by 4
  18. 2023Stackelberg Decision Transformer for Asynchronous Action Coordination in Multi-Agent Systemscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 19; 2025: 17; 2026: 2.

38 papers.

Sort:

By area:

  1. 2024Scaling Large Language Model-based Multi-Agent Collaborationcited by 241
  2. 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
  3. 2024FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Makingcited by 113
  4. 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 99
  5. 2024Embodied LLM Agents Learn to Cooperate in Organized Teamscited by 82
  6. 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
  7. 2024SQLBench: A Comprehensive Evaluation for Text-to-SQL Capabilities of Large Language Modelscited by 32
  8. 2024PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistencycited by 27
  9. 2024DMQR-RAG: Diverse Multi-Query Rewriting for RAGcited by 27
  10. 2024Hierarchical Auto-Organizing System for Open-Ended Multi-Agent Navigationcited by 24
  11. 2025VeriPlan: Integrating Formal Verification and LLMs into End-User Planningcited by 20
  12. 2025Reasoning RAG via System 1 or System 2: A Survey on Reasoning Agentic Retrieval-Augmented Generation for Industry Challengescited by 19
26 more
  1. 2024Probabilistically Correct Language-based Multi-Robot Planning using Conformal Predictioncited by 18
  2. 2025Generative Multi-Agent Collaboration in Embodied AI: A Systematic Reviewcited by 13
  3. 2024Stop Wandering, Find the Keys: LLMs Discriminate Key States for Efficient Multi-Agent Explorationcited by 9
  4. 2024From Text to Life: On the Reciprocal Relationship between Artificial Life and Large Language Modelscited by 8
  5. 2024Verco: Learning Coordinated Verbal Communication for Multi-agent Reinforcement Learningcited by 7
  6. 2024CAMON: Cooperative Agents for Multi-Object Navigation with LLM-based Conversationscited by 7
  7. 2024Good Parenting is all you need -- Multi-agentic LLM Hallucination Mitigationcited by 7
  8. 2025Enhancing Decision-Making of Large Language Models via Actor-Criticcited by 7
  9. 2025CREW-WILDFIRE: Benchmarking Agentic Multi-Agent Collaborations at Scalecited by 7
  10. 2025QLLM: Do We Really Need a Mixing Network for Credit Assignment in Multi-Agent Reinforcement Learning?cited by 6
  11. 2024Enhancing Language Model Rationality with Bi-Directional Deliberation Reasoningcited by 5
  12. 2025StorySage: Conversational Autobiography Writing Powered by a Multi-Agent Frameworkcited by 4
  13. 2024Knowing What Not to Do: Leverage Language Model Insights for Action Space Pruning in Multi-agent Reinforcement Learningcited by 3
  14. 2024Skin Cancer Detection utilizing Deep Learning: Classification of Skin Lesion Images using a Vision Transformercited by 3
  15. 2025BELLE: A Bi-Level Multi-Agent Reasoning Framework for Multi-Hop Question Answeringcited by 3
  16. 2025ORAN-GUIDE: RAG-Driven Prompt Learning for LLM-Augmented Reinforcement Learning in O-RAN Network Slicingcited by 3
  17. 2025NGENT: Next-Generation AI Agents Must Integrate Multi-Domain Abilities to Achieve Artificial General Intelligencecited by 2
  18. 2025Prompt-Tuned LLM-Augmented DRL for Dynamic O-RAN Network Slicingcited by 2
  19. 2025Fishing for Answers: Exploring One-shot vs. Iterative Retrieval Strategies for Retrieval Augmented Generationcited by 2
  20. 2024GRATR: Zero-Shot Evidence Graph Retrieval-Augmented Trustworthiness Reasoningcited by 1
  21. 2025LLMs Meet Cross-Modal Time Series Analytics: Overview and Directionscited by 1
  22. 2025Subgoal Graph-Augmented Planning for LLM-Guided Open-World Reinforcement Learningcited by 1
  23. 2024Exploring Genre and Success Classification through Song Lyrics using DistilBERT: A Fun NLP Venturecited by 0
  24. 2025GPG: Generalized Policy Gradient Theorem for Transformer-based Policiescited by 0
  25. 2026Neural Nonmyopic Bayesian Optimization in Dynamic Cost Settingscited by 0
  26. 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systemscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Large Language Model based Multi-Agents: A Survey of Progress and Challenges
  2. 2025From Language to Action: A Review of Large Language Models as Autonomous Agents and Tool Users
  3. 2025LLM-Agent-Controller: A Universal Multi-Agent Large Language Model System as a Control Engineer
  4. 2024Understanding the planning of LLM agents: A survey
  5. 2025Grounding Natural Language for Multi-agent Decision-Making with Multi-agentic LLMs
  6. 2023Improving Planning with Large Language Models: A Modular Agentic Architecture
  7. 2024LLaMAR: Long-Horizon Planning for Multi-Agent Robots in Partially Observable Environments
  8. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challenges