# Active Hypothesis Testing under Computational Budgets with Applications to GWAS and LLM

arXiv: https://arxiv.org/abs/2512.01423 · HTML: https://mlsanity.com/paper/2512.01423/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 1 Dec 2025.

## Built on by (most cited first, 1 of 1)

- [Adaptive auditing of AI systems with anytime-valid guarantees](https://mlsanity.com/paper/2605.07002/) (2026)

## Abstract (arXiv)

In large-scale hypothesis testing, computing exact p-values or e-values is often resource-intensive, creating a need for budget-aware inferential methods. We propose a general framework for active hypothesis testing that leverages inexpensive auxiliary statistics to allocate a global computational budget. For each hypothesis, our data-adaptive procedure probabilistically decides whether to compute the exact test statistic or a transformed proxy, guaranteeing a valid p-value or e-value while satisfying the exact budget constraint. Theoretical guarantees are established for our constructions, showing that the procedure achieves optimality for e-values and for p-values under independence, and admissibility for p-values under general dependence. Empirical results from simulations and two real-world applications, including a large-scale genome-wide association study (GWAS) and a clinical prediction task leveraging large language models (LLM), demonstrate that our framework improves statistical efficiency under fixed resource limits.