Game-theoretic statistics and safe anytime-valid inference
Not on the map. Why?
Abstract (arXiv)
Safe anytime-valid inference (SAVI) provides measures of statistical evidence and certainty -- e-processes for testing and confidence sequences for estimation -- that remain valid at all stopping times, accommodating continuous monitoring and analysis of accumulating data and optional stopping or continuation for any reason. These measures crucially rely on test martingales, which are nonnegative martingales starting at one. Since a test martingale is the wealth process of a player in a betting game, SAVI centrally employs game-theoretic intuition, language and mathematics. We summarize the SAVI goals and philosophy, and report recent advances in testing composite hypotheses and estimating functionals in nonparametric settings.
Key facts. Cited by 155 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Oct 2022.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 3; 2023: 17; 2024: 14; 2025: 27; 2026: 94.
155 papers.
Sort:
By area:
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2022Anytime-valid off-policy inference for contextual banditscited by 37
- 2024A Unified Confidence Sequence for Generalized Linear Models, with Applications to Banditscited by 29
- 2023A unified recipe for deriving (time-uniform) PAC-Bayes boundscited by 25
- 2023Auditing Fairness by Bettingcited by 25
- 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversioncited by 24
- 2023Semiparametric Efficient Inference in Adaptive Experimentscited by 23
- 2024Protected Test-Time Adaptation via Online Entropy Matching: A Betting Approachcited by 23
- 2025E-valuator: Reliable Agent Verifiers with Sequential Hypothesis Testingcited by 17
- 2025Prediction-Powered E-Valuescited by 16
- 2025WATCH: Adaptive Monitoring for AI Deployments via Weighted-Conformal Martingalescited by 16
- 2024Adaptive Learn-then-Test: Statistically Valid and Efficient Hyperparameter Selectioncited by 15
38 more
- 2024Active, anytime-valid risk controlling prediction setscited by 14
- 2025Is Your Imitation Learning Policy Better than Mine? Policy Comparison with Near-Optimal Stoppingcited by 14
- 2026PACE: Anytime-Valid Acceptance Tests for Self-Evolving Agentscited by 13
- 2023Online multiple testing with e-valuescited by 12
- 2024Online Detection of LLM-Generated Texts via Sequential Hypothesis Testing by Bettingcited by 11
- 2025Adaptive Prediction-Powered AutoEval with Reliability and Efficiency Guaranteescited by 11
- 2025Monitoring Risks in Test-Time Adaptationcited by 11
- 2022E-Valuating Classifier Two-Sample Testscited by 10
- 2023Likelihood Ratio Confidence Sets for Sequential Decision Makingcited by 10
- 2025On Continuous Monitoring of Risk Violations under Unknown Shiftcited by 10
- 2022Near-Optimal Non-Parametric Sequential Tests and Confidence Sequences with Possibly Dependent Observationscited by 9
- 2024Peeking with PEAK: Sequential, Nonparametric Composite Hypothesis Tests for Means of Multiple Data Streamscited by 9
- 2024An Auditing Test To Detect Behavioral Shift in Language Modelscited by 9
- 2023Huber-Robust Confidence Sequencescited by 7
- 2023Deep anytime-valid hypothesis testingcited by 7
- 2025Anytime-valid, Bayes-assisted, Prediction-Powered Inferencecited by 7
- 2026Detecting Multi-Agent Collusion Through Multi-Agent Interpretabilitycited by 7
- 2026Resolution Diagnostics for Paired LLM Evaluationcited by 7
- 2026ToolChain-CRC: Conformal Risk Control for Agentic AI Under Retrieval and Tool-Use Driftcited by 6
- 2026Self-Evolving Agents with Anytime-Valid Certificatescited by 6
- 2023Incentive-Theoretic Bayesian Inference for Collaborative Sciencecited by 5
- 2024Reward Maximization for Pure Exploration: Minimax Optimal Good Arm Identification for Nonparametric Multi-Armed Banditscited by 5
- 2025Post-detection inference for sequential changepoint localizationcited by 5
- 2025Generalization Bounds and Stopping Rules for Learning with Self-Selected Datacited by 5
- 2023Active Sequential Two-Sample Testingcited by 4
- 2025Optimistic Interior Point Methods for Sequential Hypothesis Testing by Bettingcited by 4
- 2025Vector-valued self-normalized concentration inequalities beyond sub-Gaussianitycited by 4
- 2025Stopping Rules for Stochastic Gradient Descent via Anytime-Valid Confidence Sequencescited by 4
- 2026Testing For Distribution Shifts with Conditional Conformal Test Martingalescited by 4
- 2026The Stability of Online Algorithms in Performative Predictioncited by 4
- 2026When Can Conformal Risk Control Certify LLM Outputs? Bounds, Impossibility, and Adaptation for Structured Generationcited by 4
- 2026Certified Interventional Fidelity: Anytime-Valid, Adaptive Evaluation of Causal Claims in Mechanistic Interpretabilitycited by 4
- 2026Efficient Sequential Evaluation of Large Language Modelscited by 4
- 2023The extended Ville's inequality for nonintegrable nonnegative supermartingalescited by 3
- 2024Combining Evidence Across Filtrationscited by 3
- 2024Asymptotic Time-Uniform Inference for Parameters in Averaged Stochastic Approximationcited by 3
- 2025Toward Universal Laws of Outlier Propagationcited by 3
- 2025Simulation-Based Inference for Adaptive Experimentscited by 3
50 most cited of 155 All 155 (JSON)
- 2026Runtime Monitoring of Supermartingale Certificates14 Oct 2026
- 2026Learning to Detect Shifts in Unstructured Data Streams via Monitoring-by-Betting12 Oct 2026
- 2026Monitoring for Shifts at Unknown Times: Parameter-Free Conditional Conformal Martingales12 Oct 2026
- 2026SLICE: Sequential Likelihood-Free Inference via Conformal E-Values9 Oct 2026
- 2026The Limits of Query Monitoring against Distributed Model Extraction9 Oct 2026
- 2026The Premise Is the Problem: Exchangeability Failure in Self-Monitored Test-Time Adaptation4 Oct 2026
- 2026When Is Enough Enough in Self-Evolving LLM Systems?3 Oct 2026
- 2026When May a Bandit Leave Its Anchor? E-Process-Authorized Thompson Sampling under Non-stationarity2 Oct 2026
- 2026GTDD: Generative Test-Driven Development for AI Coding Agents with Adversarial Testing2 Oct 2026
- 2026Evidence-Gated Research: Statistically Controlled Model Adoption in Adaptive Search1 Oct 2026
- 2026Verify Claims, Not Scores: Evidence-Based Verification of Modular Agents1 Oct 2026
- 2026Prequential E-Values for Selected-GP Near-Optimality Certificates30 Sep 2026
38 more
- 2026Always-On Experimentation30 Sep 2026
- 2026The Price of Peeking: Anytime-Valid Leakage Detection on ML-KEM EM Traces27 Sep 2026
- 2026Which Self-Improvements Should We Trust? Reliable Self-Improvement When Agents Reuse Their Benchmarks27 Sep 2026
- 2026Anytime-Valid LLM Leaderboards via Benchmark-weighted and Block-Factorized e-Processes26 Sep 2026
- 2026Rank Confidence Sequences:Anytime-valid Leaderboards26 Sep 2026
- 2026On Evaluating and Improving Conversational Agents in Production25 Sep 2026
- 2026Trains but Doesn't Learn: A Post-Training Delivery Benchmark for LLM Agents as Forward-Deployed Engineers21 Sep 2026
- 2026Human-LLM Deliberation as Interactive Proof: Conditions for Verifiability Without Transparency21 Sep 2026
- 2026The Price of Self-Calibration: Exact Evidence Budgets and Manufactured Blind Sets in Adaptive Monitoring19 Sep 2026
- 2026How Many Posterior Samples? Calibrated Stopping for Adaptive Sensing18 Sep 2026
- 2026No Free Checker: A Survey of Verifiers for Robot Policies8 Sep 2026
- 2026Discovering Translation-Worthy Languages with E-Values6 Sep 2026
- 2026A complete characterization of sequential testability and change detectability in i.i.d. models4 Sep 2026
- 2026The Impossible Trinity of Time-Series Validation: A Conservation Law among Training Sufficiency, Test Coverage, and Temporal Causality2 Sep 2026
- 2026When the Martingale Never Stops Firing: Anytime-Valid Gating on Real Forecast Streams31 Aug 2026
- 2026CURA: Certified Runtime Alarms for Computer-Use Agents28 Aug 2026
- 2026The Type-II Error of Test Supermartingales: e-Power versus the Chernoff-Stein Exponent19 Aug 2026
- 2026AccretionLink: On-Device Auditing of Exposure-Control Attacks on Attribute Inference13 Aug 2026
- 2026Agent Behavioral Contracts II: Certifying Compositional Reliability Without Assuming Independence13 Aug 2026
- 2026Deciding When to Switch: E-Processes for Adaptive Minimax Training for Generative Adversarial Nets10 Aug 2026
- 2026Private Anytime Selective-Risk Certification for Federated Retrieval-Augmented Generation: Guarantees and Empirical Limits8 Aug 2026
- 2026NxN E-valuation: Hypothesis Certification via a Conformal CRT Null6 Aug 2026
- 2026AV-AIVAT: 74x Cheaper Agent Evaluation with Certified Anytime-Valid Stopping in Imperfect-Information Games6 Aug 2026
- 2026Runtime Observability for Heterogeneous Attention Memory6 Aug 2026
- 2026Anytime-Valid Confirmation of Covariate Balance for Prespecified Corrections25 Jul 2026
- 2026Efficient Online LLM Watermark Detection via Rao-Blackwellized E-Processes24 Jul 2026
- 2026Error Certificates for KV-Cache Eviction via Randomized Design23 Jul 2026
- 2026Pay Only for Disagreement: Certified No-Regression Verdicts for Model Updates with Matching Label-Complexity Bounds22 Jul 2026
- 2026CUSUM-Shaped Inference-Time Monitoring and Targeted Re-Decoding for Quantized Small Language Model Reasoning22 Jul 2026
- 2026Detect Early, Escalate Rarely: Anytime Detection of AI-Generated Video from the Compressed Bitstream21 Jul 2026
- 2026Efficient Sequential Evaluation of Large Language Models19 Jul 2026
- 2026Bet on Features: Anytime-Valid and Feature-Aware Auditing of Conditional Quantile Forecasters13 Jul 2026
- 2026Calibrated e-CUSUM Decoding for Quantized Reasoning Models: Why Token Log-Probability Is the Wrong Observable for Decoding Monitors13 Jul 2026
- 2026Certified Interventional Fidelity: Anytime-Valid, Adaptive Evaluation of Causal Claims in Mechanistic Interpretability9 Jul 2026
- 2026Online Safety Monitoring for LLMs2 Jul 2026
- 2026Sequential Structure-Sensitive Residual Diagnostics for PDE Inverse Problems2 Jul 2026
- 2026Self-Evolving Agents with Anytime-Valid Certificates1 Jul 2026
- 2026Sequential Fairness Auditing with Limited Output Access29 Jun 2026
50 newest of 155 All 155 (JSON)
- 2026Detecting Multi-Agent Collusion Through Multi-Agent Interpretabilitycited by 7
- 2026ToolChain-CRC: Conformal Risk Control for Agentic AI Under Retrieval and Tool-Use Driftcited by 6
- 2026When Agents Disagree With Themselves: Behavioral Consistency as an Uncertainty Signal for LLM Agentscited by 3
- 2026Green SARC: Predictive Cost and Carbon Governance for Agentic AI Systemscited by 3
- 2026Agent Behavioral Contracts II: Certifying Compositional Reliability Without Assuming Independencecited by 3
- 2026Position: A Three-Layer Probabilistic Assume-Guarantee Architecture Is Structurally Required for Safe LLM Agent Deploymentcited by 1
- 2026Locally Coherent, Globally Incoherent: Bounding Compositional Incoherence in Multi-Component LLM Agentscited by 1
- 2026AV-AIVAT: 74x Cheaper Agent Evaluation with Certified Anytime-Valid Stopping in Imperfect-Information Gamescited by 1
- 2026Trains but Doesn't Learn: A Post-Training Delivery Benchmark for LLM Agents as Forward-Deployed Engineerscited by 0
- 2026On Evaluating and Improving Conversational Agents in Productioncited by 0
- 2026GTDD: Generative Test-Driven Development for AI Coding Agents with Adversarial Testingcited by 0
- 2026GTDD: Generative Test-Driven Development for AI Coding Agents with Adversarial Testing2 Oct 2026
- 2026On Evaluating and Improving Conversational Agents in Production25 Sep 2026
- 2026Trains but Doesn't Learn: A Post-Training Delivery Benchmark for LLM Agents as Forward-Deployed Engineers21 Sep 2026
- 2026Agent Behavioral Contracts II: Certifying Compositional Reliability Without Assuming Independence13 Aug 2026
- 2026AV-AIVAT: 74x Cheaper Agent Evaluation with Certified Anytime-Valid Stopping in Imperfect-Information Games6 Aug 2026
- 2026ToolChain-CRC: Conformal Risk Control for Agentic AI Under Retrieval and Tool-Use Drift16 Jun 2026
- 2026Green SARC: Predictive Cost and Carbon Governance for Agentic AI Systems14 Jun 2026
- 2026Locally Coherent, Globally Incoherent: Bounding Compositional Incoherence in Multi-Component LLM Agents28 May 2026
- 2026Position: A Three-Layer Probabilistic Assume-Guarantee Architecture Is Structurally Required for Safe LLM Agent Deployment18 May 2026
- 2026Detecting Multi-Agent Collusion Through Multi-Agent Interpretability1 Apr 2026
- 2026When Agents Disagree With Themselves: Behavioral Consistency as an Uncertainty Signal for LLM Agents12 Feb 2026
- 2025E-valuator: Reliable Agent Verifiers with Sequential Hypothesis Testingcited by 17
- 2026Budgeted Act-or-Defer Multi-Agent LLM Deliberation with Local Reliability Boundscited by 1
- 2026CUSUM-Shaped Inference-Time Monitoring and Targeted Re-Decoding for Quantized Small Language Model Reasoningcited by 1
- 2026Calibrated e-CUSUM Decoding for Quantized Reasoning Models: Why Token Log-Probability Is the Wrong Observable for Decoding Monitorscited by 0
- 2026CUSUM-Shaped Inference-Time Monitoring and Targeted Re-Decoding for Quantized Small Language Model Reasoning22 Jul 2026
- 2026Calibrated e-CUSUM Decoding for Quantized Reasoning Models: Why Token Log-Probability Is the Wrong Observable for Decoding Monitors13 Jul 2026
- 2026Budgeted Act-or-Defer Multi-Agent LLM Deliberation with Local Reliability Bounds28 Jun 2026
- 2025E-valuator: Reliable Agent Verifiers with Sequential Hypothesis Testing2 Dec 2025
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2026Runtime Observability for Heterogeneous Attention Memorycited by 1
- 2026Runtime Observability for Heterogeneous Attention Memory6 Aug 2026
- 2026When Is Enough Enough in Self-Evolving LLM Systems?cited by 1
- 2026When Is Enough Enough in Self-Evolving LLM Systems?3 Oct 2026
- 2022Anytime-valid off-policy inference for contextual banditscited by 37
- 2024A Unified Confidence Sequence for Generalized Linear Models, with Applications to Banditscited by 29
- 2023A unified recipe for deriving (time-uniform) PAC-Bayes boundscited by 25
- 2023Auditing Fairness by Bettingcited by 25
- 2023Improved Regret Bounds of (Multinomial) Logistic Bandits via Regret-to-Confidence-Set Conversioncited by 24
- 2023Semiparametric Efficient Inference in Adaptive Experimentscited by 23
- 2024Protected Test-Time Adaptation via Online Entropy Matching: A Betting Approachcited by 23
- 2025Prediction-Powered E-Valuescited by 16
- 2025WATCH: Adaptive Monitoring for AI Deployments via Weighted-Conformal Martingalescited by 16
- 2024Adaptive Learn-then-Test: Statistically Valid and Efficient Hyperparameter Selectioncited by 15
- 2024Active, anytime-valid risk controlling prediction setscited by 14
- 2026PACE: Anytime-Valid Acceptance Tests for Self-Evolving Agentscited by 13
12 most cited of 129 All 129 (JSON)
- 2026Runtime Monitoring of Supermartingale Certificates14 Oct 2026
- 2026Learning to Detect Shifts in Unstructured Data Streams via Monitoring-by-Betting12 Oct 2026
- 2026Monitoring for Shifts at Unknown Times: Parameter-Free Conditional Conformal Martingales12 Oct 2026
- 2026SLICE: Sequential Likelihood-Free Inference via Conformal E-Values9 Oct 2026
- 2026The Limits of Query Monitoring against Distributed Model Extraction9 Oct 2026
- 2026The Premise Is the Problem: Exchangeability Failure in Self-Monitored Test-Time Adaptation4 Oct 2026
- 2026When May a Bandit Leave Its Anchor? E-Process-Authorized Thompson Sampling under Non-stationarity2 Oct 2026
- 2026Evidence-Gated Research: Statistically Controlled Model Adoption in Adaptive Search1 Oct 2026
- 2026Verify Claims, Not Scores: Evidence-Based Verification of Modular Agents1 Oct 2026
- 2026Prequential E-Values for Selected-GP Near-Optimality Certificates30 Sep 2026
- 2026Always-On Experimentation30 Sep 2026
- 2026The Price of Peeking: Anytime-Valid Leakage Detection on ML-KEM EM Traces27 Sep 2026
12 newest of 129 All 129 (JSON)