mlsanityData to 14 Oct 2026

Triage-PiEvo: Evidence Admission for Principle-Evolving Scientific Agents

arXiv 2610.14683 ↗First posted 10 Oct 2026cs.LGcited by 0

On the map: LLM agents and tool use → Web, search, and research agents also fits: Medical and scientific domain agents

Abstract (arXiv)

Large language model (LLM)-based AI Scientists advance scientific discovery, yet they suffer from inefficiencies due to noisy observations. Existing principle-evolving agents act on every anomaly, leaving its source unresolved: a new mechanism or an evaluation artifact, so invalid revisions bias evolution. To address this, we formulate revision as evidence admission: anomalies steer search immediately, but only independently verified evidence may rewrite persistent principles, and contradicted principles are retracted. We realize this in TRIAGE-PIEVO , which pairs an anomaly-responsive search portfolio with a staged verification gate that alone controls what enters principle state. Across four scientific tasks with three backbones, TRIAGE-PIEVO (1) attains the highest average solution quality with +7.5%~11.8% over the strongest baseline per backbone, matching the strongest baseline's full-budget quality with one-third of the evaluation budget on Qwen3-235B; and additional stress tests and cross-harness deployment demonstrate that (2) in constructed stress tests, it admits none of the corrupted, hidden-source, or exploit evidence that ungated variants admit, while missing no planted mechanism, and (3) plugged unchanged into three external research harnesses, it cuts false evidence admissions by over 60% and raises verified scores by 31%~43%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 34 of its 52 references that are in the map. First posted on arXiv 10 Oct 2026.

Builds on

34 of 52 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Tasks14 Aug
  2. 2026EvoMaster: A Foundational Evolving Agent Framework for Agentic Science at Scale19 Apr
  3. 2025SciToolAgent: A Knowledge Graph-Driven Scientific Agent for Multi-Tool Integration27 Jul
  4. 2025AI-Researcher: Autonomous Scientific Innovation24 May
  5. 2025PiFlow: Principle-Aware Scientific Discovery with Multi-Agent Collaboration21 May
  6. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search10 Apr
  7. 2025Agent Laboratory: Using LLM Agents as Research Assistants8 Jan
  8. 2024Aviary: training language agents on challenging scientific tasks30 Dec
  9. 2024Language agents achieve superhuman synthesis of scientific knowledge10 Sep

Other references · 25

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  4. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  5. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
  6. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  7. 2019Scalable Global Optimization via Local Bayesian Optimizationcited by 374
  8. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 324
  9. 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 240
  10. 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Researchcited by 156
  11. 2017Multi-fidelity Bayesian Optimisation with Continuous Approximationscited by 121
  12. 2025Kosmos: An AI Scientist for Autonomous Discoverycited by 92
13 more
  1. 2025BixBench: a Comprehensive Benchmark for LLM-based Agents in Computational Biologycited by 89
  2. 2016Multi-Information Source Optimizationcited by 84
  3. 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 72
  4. 2022Multi-Fidelity Bayesian Optimization with Unreliable Information Sourcescited by 18
  5. 2026AI scientists produce results without reasoning scientificallycited by 17
  6. 2026The Last Human-Written Paper: Agent-Native Research Artifactscited by 16
  7. 2026Can AI agents conduct open-ended AI research? Early evidence from two case studiescited by 10
  8. 2026Principle-Evolvable Scientific Discovery via Uncertainty Minimizationcited by 7
  9. 2026Guideline-Grounded Evidence Accumulation for High-Stakes Agent Verificationcited by 5
  10. 2026ATLAS: Active Theory Learning for Automated Sciencecited by 5
  11. 2026Self-Revising Discovery Systems for Science: A Categorical Framework for Agentic Artificial Intelligencecited by 4
  12. 2026Active Flow Expansion for Out-of-Distribution Discovery: from Theory to Moleculescited by 3
  13. 2026Monitoring Agentic Systems Before They're Reliablecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026EPOCH: Reliable Discovery through Evidence-Governed Search
  2. 2026Toward Auditable AI Scientists: A Hypothesis Evolution Protocol for LLM Agents
  3. 2026ScienceClaw: Benchmarking Continual Self-Evolution of AI-for-Science Agents Across the Natural and Social Sciences
  4. 2026EvoSCM: Scientific Belief Revision Through Causal Model Evolution and Experimentation
  5. 2026CliffSearch: Structured Agentic Co-Evolution over Theory and Code for Scientific Algorithm Discovery
  6. 2026Harnessing Agentic Evolution
  7. 2025ATHENA: Agentic Team for Hierarchical Evolutionary Numerical Algorithms
  8. 2026InferenceEvolve: Towards Automated Causal Effect Estimators through Self-Evolving AI