Cross-domain benchmarks reveal when coordinated AI agents improve scientific inference from partial evidence
Not on the map. Why?
Abstract (arXiv)
Scientific evidence often spans instruments, databases, and disciplines, so no single source records the full phenomenon. This makes it difficult to determine when coordinated AI agents add value over simpler scientific workflows. We evaluate this question with a cross-domain benchmark spanning four scientific tasks: mapping molecular structure into musical representations, detecting historical paradigm shifts in science, identifying vector-borne disease emergence, and vetting transiting-exoplanet candidates. Each case uses a frozen evaluation panel, predefined scoring protocols, explicit baselines, ablations or null controls, and stated limitations. The results define three operating regimes. When different disciplines each capture only part of the phenomenon, cross-channel composites improve over single-channel baselines: climate-vector emergence reaches AUROC 0.944 and exoplanet vetting reaches AUROC 0.955. However, the exoplanet workflow is effectively tied with a strong combined-summary baseline, showing that decomposition does not always improve top-line performance. When one signal dominates, as in paradigm-shift detection, coordination mainly improves interpretation and traceability. For molecular sonification, the gain is representational rather than predictive. ScienceClaw x Infinite provides the auditable artifact and provenance layer for this evaluation. The benchmark therefore assigns value to coordination only when the corresponding performance, provenance, or representation claim is supported by explicit comparators.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 40 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
13 of 40 references.
References · 13
- 2025Accelerating scientific discovery with Co-Scientistcited by 401
- 2026Towards End-to-End Automation of AI Researchcited by 159
- 2024Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilitiescited by 69
- 2024ProtAgents: Protein discovery via large language model multi-agent collaborations combining physics and machine learningcited by 64
- 2025An AI system to help scientists write expert-level empirical softwarecited by 60
- 2023BioinspiredLLM: Conversational Large Language Model for the Mechanics of Biological and Bio-inspired Materialscited by 30
- 2024Accelerating Scientific Discovery with Generative Knowledge Extraction, Graph-Based Representation, and Multimodal Intelligent Graph Reasoningcited by 27
- 2024PRefLexOR: Preference-based Recursive Language Modeling for Exploratory Optimization of Reasoning and Agentic Thinkingcited by 17
- 2026Autonomous Agents Coordinating Distributed Discovery Through Emergent Artifact Exchangecited by 11
- 2026GraphAgents: Knowledge Graph-Guided Agentic AI for Cross-Domain Materials Designcited by 9
- 2023AI for Science: An Emerging Agendacited by 5
- 2024Learning the rules of peptide self-assembly through data mining with large language modelscited by 5
Built on by
Not cited yet.