mlsanityData to 7 Oct 2026

Reasoning-Aware Prompt Orchestration: A Foundation Model for Multi-Agent Language Model Coordination

arXiv 2510.00326 ↗First posted 30 Sep 2025cs.MA cs.AIcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

The emergence of large language models has enabled sophisticated multi-agent systems, yet coordinating their reasoning capabilities through prompt engineering remains challenging. We present a theoretically-grounded framework for dynamic prompt orchestration that enhances reasoning across multiple specialized agents. This framework addresses three core challenges: logical consistency preservation during agent transitions, reasoning-aware prompt adaptation, and scalable coordination of distributed inference. Our approach formalizes agent states using prompt templates, reasoning context vectors, and capability matrices. We prove system convergence to stable coordination patterns when step sizes satisfy α < frac12L where L is the Lipschitz constant of the state transition function. We implement this through a distributed architecture that dynamically routes reasoning tasks while maintaining semantic coherence. Experimental results on 1,000 synthetic multi-agent conversations demonstrate a 42% reduction in reasoning latency, a 23% improvement in logical consistency measured by ROUGE-L score, and an 89% success rate for task completion without context loss across agent transitions. Ablation studies identify the consensus mechanism as the primary performance driver, while revealing limitations: performance degrades beyond 10 agent transitions, and the system requires 76.5GB memory for 1,000 concurrent agents. These findings establish a new paradigm for scalable reasoning in multi-agent systems, providing theoretical foundations for understanding reasoning emergence across coordinated language models.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 10 of its 14 references that are in the map. First posted on arXiv 30 Sep 2025.

Builds on

10 of 14 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023On the Discussion of Large Language Models: Symmetry of Agents and Interplay with Prompts13 Nov

Other references · 9

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  4. 2024Efficient multi-prompt evaluation of LLMscited by 72
  5. 2025A Survey of Automatic Prompt Engineering: An Optimization Perspectivecited by 41
  6. 2024Multi-expert Prompting Improves Reliability, Safety, and Usefulness of Large Language Modelscited by 13
  7. 2024AMPO: Automatic Multi-Branched Prompt Optimizationcited by 11
  8. 2024Prompting-based Synthetic Data Generation for Few-Shot Question Answeringcited by 9
  9. 2023MultiPrompter: Cooperative Prompt Optimization with Multi-Agent Reinforcement Learningcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026A Survey of Agentic Reasoning for Large Language Models: Towards Recursively Self-Improving and Collective Agents
  2. 2025Benefits and Limitations of Communication in Multi-Agent Reasoning
  3. 2026Agent-GWO: Collaborative Agents for Dynamic Prompt Optimization in Large Language Models
  4. 2025HALO: Hierarchical Autonomous Logic-Oriented Orchestration for Multi-Agent LLM Systems
  5. 2025CodeAgents: A Token-Efficient Framework for Codified Multi-Agent Reasoning in LLMs
  6. 2025MAPRO: Recasting Multi-Agent Prompt Optimization as Maximum a Posteriori Inference
  7. 2026Decentralized Multi-Agent Systems with Shared Context
  8. 2025MARS: Multi-Agent Adaptive Reasoning with Socratic Guidance for Automated Prompt Optimization