LabBook: Harnessing Experimental History for Efficient LLM-Driven Discovery
Not on the map. Why?
Abstract (arXiv)
Evolutionary approaches to LLM-driven discovery often generate new programs from a small set of selected ancestors. This keeps contexts manageable but can omit useful evidence from other experiments, whereas including the full experimental history produces long, redundant contexts. We introduce a simple, single-agent discovery harness built around LabBook, an agent-maintained memory that serves two complementary roles: guiding retrieval of relevant evidence from a complete experimental log and informing the generation of new solutions. At each iteration, the same agent combines its memory with retrieved evidence and jointly produces the next program and an updated LabBook. This separates complete history retention from selective context construction, without requiring an explicit population or branching search structure. On 49 Frontier-CS problems, LabBook improves the observed quality-cost trade-off over the evaluated evolutionary baselines with two backbones, while remaining competitive across nine additional mathematical, systems, and heuristic-design tasks. Code will be released at https://github.com/BoYuanVisionary/LabBook.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 32 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
23 of 32 references.
References · 23
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
- 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
- 2023Large Language Models as Optimizerscited by 830
- 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
- 2025AlphaEvolve: A coding agent for scientific and algorithmic discoverycited by 763
- 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 294
- 2024ReEvo: Large Language Models as Hyper-Heuristics with Reflective Evolutioncited by 266
- 2024Evolution of Heuristics: Towards Efficient Automatic Algorithm Design Using Large Language Modelcited by 258
- 2025ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memorycited by 253
11 more
- 2025ShinkaEvolve: Towards Open-Ended And Sample-Efficient Program Evolutioncited by 146
- 2025Barbarians at the Gate: How AI is Upending Systems Researchcited by 48
- 2026AdaEvolve: Adaptive LLM Driven Zeroth-Order Optimizationcited by 46
- 2026EvoX: Meta-Evolution for Automated Discoverycited by 45
- 2025CodeEvolve: an open source evolutionary coding agent for algorithmic discovery and optimizationcited by 37
- 2026DeltaEvolve: Accelerating Scientific Discovery through Momentum-Driven Evolutioncited by 23
- 2025HeuriGym: An Agentic Benchmark for LLM-Crafted Heuristics in Combinatorial Optimizationcited by 19
- 2025FrontierCS: Evolving Challenges for Evolving Intelligencecited by 19
- 2026Dream-RSI: Recursive Self-Improvement through Evolving Worldscited by 9
- 2026CausalEvolve: Towards Open-Ended Discovery with Causal Scratchpadcited by 3
- 2026RefineEvo: Planning-Guided Heuristic Evolution with Bidirectional Experiencecited by 2
Built on by
Not cited yet.