Extending AI for Research to the Humanities: A Multi-Agent Framework for Evidence-Grounded Scholarship
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
LLM-based research agents have advanced rapidly in science and engineering, where research is organized around executable experiments, code, and quantitative signals. Humanities scholarship, however, requires interpretive, evidence-grounded arguments over primary sources, whose value rests on faithful quotation, verifiable provenance, and deep interpretation. Existing research agents use general planning, tool use, and reflection, leaving these scholarly operations implicit. To address this gap, we introduce SPIRE (Scholarly-Primitives-Inspired Research Engine), a multi-agent framework that realizes Scholarly Primitives, a typology of basic humanities scholarship practices, as cooperating roles over a multi-scale close-reading substrate of passages, intra-context graph communities, and cross-context semantic clusters. On a benchmark of peer-reviewed papers in classical Chinese and Greco-Roman Latin scholarship, SPIRE recovers substantially more cited primary-source evidence and receives higher blind human and LLM ratings on four scholarly quality dimensions than LLM, RAG, and generic agentic baselines. Retrieval-tier and agent ablations, with retrieval-volume and answer-length controls, trace its advantage to targeted retrieval, structured evidence selection, and claim-evidence binding. Code and benchmark data are released at https://github.com/YatingPan/SPIRE.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 33 of its 108 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
33 of 108 references.
Closest ancestors · 6
Same direction, newest first
- 2025PaSa: An LLM Agent for Comprehensive Academic Paper Search17 Jan
- 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery7 Oct
- 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning9 Sep
- 2024MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agents26 Aug
- 2023PaperQA: Retrieval-Augmented Generative Agent for Scientific Research8 Dec
Other references · 27
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2017Billion-scale similarity search with GPUscited by 2,477
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
15 more
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
- 2023Enabling Large Language Models to Generate Text with Citationscited by 584
- 2018From Louvain to Leiden: guaranteeing well-connected communitiescited by 379
- 2023Large Language Models Empowered Agent-based Modeling and Simulation: A Survey and Perspectivescited by 253
- 2025AgentSociety: Large-Scale Simulation of LLM-Driven Generative Agents Advances Understanding of Human Behaviors and Societycited by 180
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 170
- 2023EconAgent: Large Language Model-Empowered Agents for Simulating Macroeconomic Activitiescited by 154
- 2025From Automation to Autonomy: A Survey on Large Language Models in Scientific Discoverycited by 86
- 2024Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligencecited by 80
- 2025HyperGraphRAG: Retrieval-Augmented Generation via Hypergraph-Structured Knowledge Representationcited by 68
- 2026Rethinking Rubric Generation for Improving LLM Judge and Reward Modeling for Open-ended Taskscited by 55
- 2024HistoLens: An LLM-Powered Framework for Multi-Layered Analysis of Historical Texts -- A Case Application of Yantie Luncited by 5
- 2025Quantitative Intertextuality from the Digital Humanities Perspective: A Surveycited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SAGE: Benchmarking and Improving Retrieval for Deep Research Agents
- 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents
- 2025AgentExpt: Automating AI Experiment Design with LLM-based Resource Retrieval Agent
- 2026Traceable Scholarship: Page Anchors and Ariadne's Thread for Humanistic Inquiry in the Age of Generative AI
- 2025Deep Research Agents: A Systematic Examination And Roadmap
- 2026ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research
- 2025WisPaper: Your AI Scholar Search Engine
- 2026Can Deep Research Agents Retrieve and Organize? Evaluating the Synthesis Gap with Expert Taxonomies