mlsanityData to 7 Oct 2026

Integrated Design and Governance of Agentic AI Systems through Adaptive Information Modulation

arXiv 2409.10372 ↗First posted 16 Sep 2024cs.AI cs.CL cs.CYcited by 4

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Modern engineered systems increasingly involve complex sociotechnical environments where multiple agents, including humans and the emerging paradigm of agentic AI powered by large language models, must navigate social dilemmas that pit individual interests against collective welfare. As engineered systems evolve toward multi-agent architectures with autonomous LLM-based agents, traditional governance approaches using static rules or fixed network structures fail to address the dynamic uncertainties inherent in real-world operations. This paper presents a novel framework that integrates adaptive governance mechanisms directly into the design of sociotechnical systems through a unique separation of agent interaction networks from information flow networks. We introduce a system comprising strategic LLM-based system agents that engage in repeated interactions and a reinforcement learning-based governing agent that dynamically modulates information transparency. Unlike conventional approaches that require direct structural interventions or payoff modifications, our framework preserves agent autonomy while promoting cooperation through adaptive information governance. The governing agent learns to strategically adjust information disclosure at each timestep, determining what contextual or historical information each system agent can access. Experimental results demonstrate that this RL-based governance significantly enhances cooperation compared to static information-sharing baselines.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 21 of its 88 references that are in the map. First posted on arXiv 16 Sep 2024.

Builds on

21 of 88 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024AgentCoord: Visually Exploring Coordination Strategy for LLM-based Multi-Agent Collaboration18 Apr
  2. 2023Theory of Mind for Multi-Agent Collaboration via Large Language Models16 Oct
  3. 2023LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models5 Oct
  4. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  5. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agents5 Jun

Other references · 16

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  3. 2023Playing repeated games with Large Language Modelscited by 213
  4. 2023War and Peace (WarAgent): Large Language Model-based Multi-Agent Simulation of World Warscited by 143
  5. 2024GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluationscited by 118
  6. 2024LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Modelscited by 97
  7. 2023Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysiscited by 91
  8. 2024How Far Are We on the Decision-Making of LLMs? Evaluating LLMs' Gaming Ability in Multi-Agent Environmentscited by 66
  9. 2024HyperAgent: Generalist Software Engineering Agents to Solve Coding Tasks at Scalecited by 61
  10. 2023MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaborationcited by 56
  11. 2023Self-Adaptive Large Language Model (LLM)-Based Multiagent Systemscited by 31
  12. 2017Statistical physics of human cooperationcited by 27
4 more
  1. 2024When AI Meets Finance (StockAgent): Large Language Model-based Stock Trading in Simulated Real-world Environmentscited by 25
  2. 2019Partner Selection for the Emergence of Cooperation in Multi-Agent Systems Using Reinforcement Learningcited by 20
  3. 2022Influencing Long-Term Behavior in Multiagent Reinforcement Learningcited by 18
  4. 2015Voluntary rewards mediate the evolution of pool punishment for maintaining public goods in large populationscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 1; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Architecting Agentic Communities using Design Patterns
  2. 2024Cooperate or Collapse: Emergence of Sustainable Cooperation in a Society of LLM Agents
  3. 2025Reliable agent engineering should integrate machine-compatible organizational principles
  4. 2026The CASE Framework: A Multi-Disciplinary Control Architecture for Governing Enterprise Agentic AI
  5. 2026Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence
  6. 2026Governance by Design: A Parsonian Institutional Architecture for Internet-Wide Agent Societies
  7. 2025Agentifying Agentic AI
  8. 2026Towards Agentic AI Governance: A Preliminary Assessment