mlsanityData to 14 Oct 2026

Adaptive Multi-Agent Reasoning via Automated Workflow Generation

arXiv 2507.14393 ↗First posted 18 Jul 2025cs.AIcited by 1

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

The rise of Large Reasoning Models (LRMs) promises a significant leap forward in language model capabilities, aiming to tackle increasingly sophisticated tasks with unprecedented efficiency and accuracy. However, despite their impressive performance, recent studies have highlighted how current reasoning models frequently fail to generalize to novel, unseen problems, often resorting to memorized solutions rather than genuine inferential reasoning. Such behavior underscores a critical limitation in modern LRMs, i.e., their tendency toward overfitting, which in turn results in poor generalization in problem-solving capabilities. In this paper, we introduce Nexus Architect, an enhanced iteration of our multi-agent system framework, Nexus, equipped with a novel automated workflow synthesis mechanism. Given a user's prompt and a small set of representative examples, the Architect autonomously generates a tailored reasoning workflow by selecting suitable strategies, tool integrations, and adversarial techniques for a specific problem class. Furthermore, the Architect includes an iterative prompt refinement mechanism that fine-tunes agents' system prompts to maximize performance and improve the generalization capabilities of the system. We empirically evaluate Nexus Architect by employing an off-the-shelf, non-reasoning model on a custom dataset of challenging logical questions and compare its performance against state-of-the-art LRMs. Results show that Nexus Architect consistently outperforms existing solutions, achieving up to a 66% increase in pass rate over Gemini 2.5 Flash Preview, nearly 2.5× against Claude Sonnet 4 and DeepSeek-R1, and over 3× w.r.t. Llama 4 Scout.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 13 of its 29 references that are in the map. First posted on arXiv 18 Jul 2025.

Builds on

13 of 29 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Nexus: A Lightweight and Scalable Multi-Agent Framework for Complex Tasks Automation26 Feb

Other references · 12

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  3. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  4. 2024On Memorization of Large Language Models in Logical Reasoningcited by 117
  5. 2024Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Datacited by 85
  6. 2023Large Language Models Are Not Strong Abstract Reasonerscited by 53
  7. 2025What Has a Foundation Model Found? Using Inductive Bias to Probe for World Modelscited by 47
  8. 2024PRewrite: Prompt Rewriting with Reinforcement Learningcited by 45
  9. 2024What Do Learning Dynamics Reveal About Generalization in LLM Reasoning?cited by 23
  10. 2025The Reasoning-Memorization Interplay in Language Models Is Mediated by a Single Directioncited by 21
  11. 2025System Prompt Optimization with Meta-Learningcited by 18
  12. 2025Recitation over Reasoning: How Cutting-Edge Language Models Can Fail on Elementary School-Level Reasoning Problems?cited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025DyFlow: Dynamic Workflow Framework for Agentic Reasoning
  2. 2025Difficulty-Aware Agentic Orchestration for Query-Specific Multi-Agent Workflows
  3. 2025Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research
  4. 2026Co-evolving Agent Architectures and Interpretable Reasoning for Automated Optimization
  5. 2026Rethinking the Value of Multi-Agent Workflow: A Strong Single Agent Baseline
  6. 2026Agentic Proposing: Enhancing Large Language Model Reasoning via Compositional Skill Synthesis
  7. 2025PAACE: A Plan-Aware Automated Agent Context Engineering Framework
  8. 2026AgentFactory: Towards Automated Agentic System Design and Optimization