mlsanityData to 14 Oct 2026

Searching for What Matters: Open-Ended Discovery of Multiple Hypotheses with Agentic Data Exploration

arXiv 2610.17874 ↗First posted 13 Oct 2026cs.LGcited by 0

On the map: LLM agents and tool use → Web, search, and research agents also fits: Medical and scientific domain agents

Abstract (arXiv)

Discovering what drives an outcome from data is central to science and often requires deciding what is worth investigating before a specific hypothesis is known. Yet most existing hypothesis generation settings substantially narrow this search by providing a research question, target relationship, or curated context. We introduce open-ended multiple hypothesis discovery, where a system receives only a large tabular dataset and an outcome and must discover multiple data-supported hypotheses without knowing in advance the relevant variables, functional forms, conditions, or number of underlying mechanisms. To study this problem, we introduce a benchmark built from structural causal models grounded in real-world data schemas, containing 351 planted hypotheses across 15 tasks and five domains, with 53--65 variables and 1M--10M rows per task. The causal model is hidden from the discovery method and retained only by the evaluator, allowing proposed hypotheses to be tested through interventions and separating observational discovery from causal validation. We further propose HypAgent, which treats the dataset as an interactive environment and performs iterative search by proposing candidate directions, triaging and refining promising hypotheses, and removing explained signal so that each accepted discovery redirects subsequent search. HypAgent achieves 0.47 precision, 0.51 recall, and 0.49 F1, compared with 0.35 F1 for the strongest baseline. Our analysis shows that many failures occur after a relevant variable has already been surfaced, suggesting that correctly characterizing a mechanism's functional form and conditions, rather than merely identifying relevant variables, remains a key challenge in open-ended discovery.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 17 of its 36 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

17 of 36 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discovery7 Oct
  2. 2024DSBench: How Far Are Data Science Agents from Becoming Data Science Experts?12 Sep
  3. 2024BLADE: Benchmarking Language Model Agents for Data-Driven Science19 Aug
  4. 2024Data Interpreter: An LLM Agent For Data Science28 Feb
  5. 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning27 Feb

Other references · 12

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  3. 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 600
  4. 2024DISCOVERYWORLD: A Virtual Environment for Developing and Evaluating Automated Scientific Discovery Agentscited by 100
  5. 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 72
  6. 2024Hypothesis Generation with Large Language Modelscited by 71
  7. 2025ResearchBench: Benchmarking LLMs in Scientific Discovery via Inspiration-Based Task Decompositioncited by 66
  8. 2025HypoBench: Towards Systematic and Principled Benchmarking for Hypothesis Generationcited by 37
  9. 2024Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluationcited by 34
  10. 2025AutoDiscovery: Open-ended Scientific Discovery via Bayesian Surprisecited by 33
  11. 2024Literature Meets Data: A Synergistic Approach to Hypothesis Generationcited by 20
  12. 2025HypoSpace: A Diagnostic Benchmark for Set-Valued Hypothesis Generation under Underdetermination and Sublinear Coverage Boundscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CausalArena: Benchmarking Causal Discovery in the Foundation Model Era
  2. 2025Hypothesis Hunting with Evolving Networks of Autonomous Scientific Agents
  3. 2024Context-Aware Reasoning On Parametric Knowledge for Inferring Causal Variables
  4. 2026Causal Discovery in the Era of Agents
  5. 2026Accelerating Social Science Research via Agentic Hypothesization and Experimentation
  6. 2024Multi-Agent Causal Discovery Using Large Language Models
  7. 2026CausalSteward: An Agentic Divide-Conquer-Combine Copilot for Causal Discovery
  8. 2026From Local to Cluster: A Unified Framework for Causal Discovery with Latent Variables