mlsanityData to 14 Oct 2026

Discovery under Hypothesis Redundancy: A Geometric Theory of Discovery Bottlenecks

arXiv 2606.14386 ↗First posted 12 Jun 2026cs.LG cs.AI q-fin.PMcited by 0

Not on the map. Why?

Abstract (arXiv)

Scientific discovery saturates when new hypotheses cease to provide independent information, even if the nominal hypothesis space remains large. We study hybrid discovery systems that combine structured local search with LLM-generated non-local proposals and pose the Search Compression Hypothesis: non-local exploration helps only when three geometric conditions co-occur: spectral compression, orthogonal escape from the explored span, and residual signal alignment with the target. We formalize these conditions, derive necessary conditions for hybrid advantage, and test the mechanism in controlled synthetic environments, large-scale A-share factor discovery, and symbolic-regression benchmarks; a public tabular operational sanity check tests the associated budget-allocation implication. Signal-planting and directed-versus-random experiments show that novelty alone is insufficient: random orthogonal jumps expand coverage but do not improve yield without predictive alignment. Across compression sweeps, real factor archives, and LLM-SRBench tasks, hybrid gains concentrate in weakly represented but target-bearing directions and vanish as the hypothesis space approaches full rank. The framework turns LLM-guided discovery from generic novelty search into a diagnostic procedure for deciding when directed non-local exploration is warranted.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 34 references that are in the map. First posted on arXiv 12 Jun 2026.

Builds on

10 of 34 references.

References · 10

  1. 2017Learning Transferable Architectures for Scalable Image Recognitioncited by 1,101
  2. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  3. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
  4. 2014OpenML: networked science in machine learningcited by 526
  5. 2017A Tutorial on Thompson Samplingcited by 433
  6. 2015An Introduction to Matrix Concentration Inequalitiescited by 397
  7. 2021Contemporary Symbolic Regression Methods and their Relative Performancecited by 215
  8. 2023Alpha-GPT: Human-AI Interactive Alpha Mining for Quantitative Investmentcited by 56
  9. 2025Chain-of-Alpha: Unleashing the Power of Large Language Models for Alpha Mining in Quantitative Tradingcited by 9
  10. 2025Iterative Hypothesis Generation for Scientific Discovery with Monte Carlo Nash Equilibrium Self-Refining Treescited by 6

Built on by

Not cited yet.