StatefulDiscovery: Evidence-Calibrated Claim Formation in Open-Ended Scientific Discovery
Not on the map. Why?
Abstract (arXiv)
Open-ended scientific discovery asks agents to move beyond executing analyses for predefined questions. Across multiple rounds of exploration, a discovery agent must decide which phenomena warrant investigation while avoiding overinterpretation, where emerging claims exceed the evidential scope of the analyses. This creates an evidence-calibration problem: the exploration trajectory must be coupled with claim status so that evidence can guide both what to investigate next and what can be claimed. We introduce textscStatefulDiscovery, a discovery framework that externalizes investigation state and uses it to coordinate frontier selection, evidence acquisition, and claim adjudication. We evaluate textscStatefulDiscovery across 40 real-data discovery tasks. Compared with several baselines, textscStatefulDiscovery produces more claims overall judged to be both well-supported and high-value. Ablations indicate distinct roles for structured hypotheses, local adjudication, frontier control and persistent states. Together, these results suggest that explicit discovery state can couple exploration with evidence-calibrated claim formation. Our code is released at hrefhttps://github.com/SUSTech-GenAI/StatefulDiscovery.githttps://github.com/SUSTech-GenAI/StatefulDiscovery.git.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 32 of its 46 references that are in the map. First posted on arXiv 10 Jun 2026.
Builds on
32 of 46 references.
References · 32
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2024Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluatorscited by 897
- 2025Accelerating scientific discovery with Co-Scientistcited by 401
- 2024Agent Workflow Memorycited by 383
- 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
- 2026Towards End-to-End Automation of AI Researchcited by 159
- 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 148
- 2026SoK: Agentic Skills -- Beyond Tool Use in LLM Agentscited by 130
- 2024DiscoveryBench: Towards Data-Driven Discovery with Large Language Modelscited by 109
- 2024HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Modelcited by 106
- 2025BixBench: a Comprehensive Benchmark for LLM-based Agents in Computational Biologycited by 89
20 more
- 2026Agentic Memory: Learning Unified Long-Term and Short-Term Memory Management for Large Language Model Agentscited by 78
- 2024BLADE: Benchmarking Language Model Agents for Data-Driven Sciencecited by 77
- 2024StateFlow: Enhancing LLM Task-Solving through State-Driven Workflowscited by 65
- 2025DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressivelycited by 63
- 2024Explaining Length Bias in LLM-Based Preference Evaluationscited by 49
- 2026SKILLFOUNDRY: Building Self-Evolving Agent Skill Libraries from Heterogeneous Scientific Resourcescited by 41
- 2025AutoDiscovery: Open-ended Scientific Discovery via Bayesian Surprisecited by 33
- 2025PiFlow: Principle-Aware Scientific Discovery with Multi-Agent Collaborationcited by 28
- 2026PACEvolve: Enabling Progress-Aware Consistent Evolutioncited by 24
- 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discoverycited by 23
- 2025Accelerating Scientific Discovery with Autonomous Goal-evolving Agentscited by 19
- 2025Empowering Scientific Workflows with Federated Agentscited by 17
- 2026HeurekaBench: A Benchmarking Framework for AI Co-scientistcited by 12
- 2026Belief Memory: Agent Memory Under Partial Observabilitycited by 11
- 2026CreativeBench: Benchmarking and Enhancing Machine Creativity via Self-Evolving Challengescited by 9
- 2026Principle-Evolvable Scientific Discovery via Uncertainty Minimizationcited by 7
- 2026From Fluent to Verifiable: Claim-Level Auditability for Deep Research Agentscited by 7
- 2026Mozi: Governed Autonomy for Drug Discovery LLM Agentscited by 5
- 2026Accelerating Social Science Research via Agentic Hypothesization and Experimentationcited by 3
- 2025Agentic Discovery: Closing the Loop with Cooperative Agentscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.