Bridging Literature and the Universe Via A Multi-Agent Large Language Model System
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
As cosmological simulations and their associated software become increasingly complex, physicists face the challenge of searching through vast amounts of literature and user manuals to extract simulation parameters from dense academic papers, each using different models and formats. Translating these parameters into executable scripts remains a time-consuming and error-prone process. To improve efficiency in physics research and accelerate the cosmological simulation process, we introduce SimAgents, a multi-agent system designed to automate both parameter configuration from the literature and preliminary analysis for cosmology research. SimAgents is powered by specialized LLM agents capable of physics reasoning, simulation software validation, and tool execution. These agents collaborate through structured communication, ensuring that extracted parameters are physically meaningful, internally consistent, and software-compliant. We also construct a cosmological parameter extraction evaluation dataset by collecting over 40 simulations in published papers from Arxiv and leading journals that cover diverse simulation types. Experiments on the dataset demonstrate a strong performance of SimAgents, highlighting its effectiveness and potential to accelerate scientific research for physicists. Our demonstration video is available at: https://youtu.be/w1zLpm_CaWA. The complete system and dataset are publicly available at https://github.com/xwzhang98/SimAgents.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 6 of its 19 references that are in the map. First posted on arXiv 11 Jul 2025.
Builds on
6 of 19 references.
References · 6
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2023Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communicationcited by 82
- 2024STOC-TOT: Stochastic Tree-of-Thought with Constrained Decoding for Complex Reasoning in Multi-Hop Question Answeringcited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Open Source Planning & Control System with Language Agents for Autonomous Scientific Discovery
- 2025The AI Cosmologist I: An Agentic System for Automated Data Analysis
- 2026Beyond AI as Assistants: Toward Autonomous Discovery in Cosmology
- 2026Reconstructing Implicit Scientific Knowledge: Evaluating LLM Agents through End-to-End Reproduction of Astronomy
- 2025Evaluating Retrieval-Augmented Generation Agents for Autonomous Scientific Discovery in Astrophysics
- 2025ReplicationBench: Can AI Agents Replicate Astrophysics Research Papers?
- 2025Kosmos: An AI Scientist for Autonomous Discovery
- 2026Beyond a Better Score: Long-Horizon Agentic ML Development and Evaluation Protocol for Physics Time Series