mlsanityData to 7 Oct 2026

Synergistic Multi-Agent Framework with Trajectory Learning for Knowledge-Intensive Tasks

arXiv 2407.09893 ↗First posted 13 Jul 2024cs.CLcited by 23

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Recent advancements in Large Language Models (LLMs) have led to significant breakthroughs in various natural language processing tasks. However, generating factually consistent responses in knowledge-intensive scenarios remains a challenge due to issues such as hallucination, difficulty in acquiring long-tailed knowledge, and limited memory expansion. This paper introduces SMART, a novel multi-agent framework that leverages external knowledge to enhance the interpretability and factual consistency of LLM-generated responses. SMART comprises four specialized agents, each performing a specific sub-trajectory action to navigate complex knowledge-intensive tasks. We propose a multi-agent co-training paradigm, Long-Short Trajectory Learning, which ensures synergistic collaboration among agents while maintaining fine-grained execution by each agent. Extensive experiments on five knowledge-intensive tasks demonstrate SMART's superior performance compared to widely adopted knowledge internalization and knowledge enhancement methods. Our framework can extend beyond knowledge-intensive tasks to more complex scenarios. Our code is available at https://github.com/yueshengbin/SMART.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 46 of its 64 references that are in the map. First posted on arXiv 13 Jul 2024.

Builds on

46 of 64 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Small LLMs Are Weak Tool Learners: A Multi-LLM Agent14 Jan
  2. 2023TPTU-v2: Boosting Task Planning and Tool Usage of Large Language Model-based Agents in Real-world Systems19 Nov
  3. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug

Other references · 43

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  6. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  7. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  8. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  9. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  10. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  11. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  12. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
31 more
  1. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  2. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  3. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  4. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
  5. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,103
  6. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  7. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
  8. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  9. 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
  10. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 734
  11. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 712
  12. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  13. 2021Editing Factual Knowledge in Language Modelscited by 548
  14. 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
  15. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 496
  16. 2022Large Language Models Struggle to Learn Long-Tail Knowledgecited by 452
  17. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 290
  18. 2019Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoningcited by 281
  19. 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 254
  20. 2023RECOMP: Improving Retrieval-Augmented LMs with Compression and Selective Augmentationcited by 253
  21. 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 231
  22. 2023RA-DIT: Retrieval-Augmented Dual Instruction Tuningcited by 194
  23. 2020Open-Domain Question Answering Goes Conversational via Question Rewritingcited by 147
  24. 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 117
  25. 2020CoLAKE: Contextualized Language and Knowledge Embeddingcited by 86
  26. 2024Unveiling the Truth and Facilitating Change: Towards Agent-based Large-scale Social Movement Simulationcited by 69
  27. 2023DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuningcited by 64
  28. 2021Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Textcited by 46
  29. 2023Self-supervised Cross-view Representation Reconstruction for Change Captioningcited by 20
  30. 2024Context-aware Difference Distilling for Multi-change Captioningcited by 10
  31. 2022Locate Then Ask: Interpretable Stepwise Reasoning for Multi-hop Question Answeringcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 13; 2026: 7.

23 papers.

Sort:

By area:

  1. 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 54
  2. 2025SocioVerse: A World Model for Social Simulation Powered by LLM Agents and A Pool of 10 Million Real-World Userscited by 50
  3. 2025A Survey on the Optimization of Large Language Model-based Agentscited by 45
  4. 2025Self-Evolving Multi-Agent Simulations for Realistic Clinical Interactionscited by 40
  5. 2024ElectionSim: Massive Population Election Simulation Powered by Large Language Model Driven Agentscited by 35
  6. 2025Multi-Agent Simulator Drives Language Models for Legal Intensive Interactioncited by 22
  7. 2025Ready Jurist One: Benchmarking Language Agents for Legal Intelligence in Dynamic Environmentscited by 13
  8. 2024PIORS: Personalized Intelligent Outpatient Reception based on Large Language Model with Multi-Agents Medical Scenario Simulationcited by 8
  9. 2025FinTeam: A Multi-Agent Collaborative Intelligence System for Comprehensive Financial Scenarioscited by 5
  10. 2025OpenRAG: Optimizing RAG End-to-End via In-Context Retrieval Learningcited by 4
  11. 2025CoCoA: Collaborative Chain-of-Agents for Parametric-Retrieved Knowledge Synergycited by 4
  12. 2025Co-Saving: Resource Aware Multi-Agent Collaboration for Software Developmentcited by 3
11 more
  1. 2025Reasoning Like an Economist: Post-Training on Economic Problems Induces Strategic Generalization in LLMscited by 2
  2. 2025Static Sandboxes Are Inadequate: Modeling Societal Complexity Requires Open-Ended Co-Evolution in LLM-Based Multi-Agent Simulationscited by 2
  3. 2026Data Science and Technology Towards AGI Part I: Tiered Data Managementcited by 2
  4. 2026MagicAgent: Towards Generalized Agent Planningcited by 2
  5. 2025Optimizing Retrieval for RAG via Reinforcement Learningcited by 1
  6. 2026ARMove: Learning to Predict Human Mobility through Agentic Reasoningcited by 1
  7. 2026AMATA: Adaptive Multi-Agent Trajectory Alignment for Knowledge-Intensive Question Answeringcited by 1
  8. 2025The Wisdom of Agent Crowds: A Human-AI Interaction Innovation Ignition Frameworkcited by 0
  9. 2026From Knowing to Acting: Benchmarking Self-Awareness Capability of LLM Agentscited by 0
  10. 2026Jailbreaking Text-to-Image Models Through Cracks: Navigating Heterogeneous Safety Filters via Multi-Agent Debatecited by 0
  11. 2026ParaAgent: Reinforcing Parallel Acting in Open-World Tool Environmentscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025ATLaS: Agent Tuning via Learning Critical Steps
  2. 2024Enhancing the General Agent Capabilities of Low-Parameter LLMs through Tuning and Multi-Branch Reasoning
  3. 2026KLong: Training LLM Agent for Extremely Long-horizon Tasks
  4. 2024KnowAgent: Knowledge-Augmented Planning for LLM-Based Agents
  5. 2025Scaling External Knowledge Input Beyond Context Windows of LLMs via Multi-Agent Collaboration
  6. 2024KoMA: Knowledge-driven Multi-agent Framework for Autonomous Driving with Large Language Models
  7. 2026Trajectory Unlearning on LLM-based Agents
  8. 2024AgentBank: Towards Generalized LLM Agents via Fine-Tuning on 50000+ Interaction Trajectories