# The power of forgetting in statistical hypothesis testing

arXiv: https://arxiv.org/abs/2402.06920 · HTML: https://mlsanity.com/paper/2402.06920/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 10 Feb 2024.

## Built on by (most cited first, 2 of 2)

- [WATCH: Adaptive Monitoring for AI Deployments via Weighted-Conformal Martingales](https://mlsanity.com/paper/2505.04608/) (2025)
- [Monitoring for Shifts at Unknown Times: Parameter-Free Conditional Conformal Martingales](https://mlsanity.com/paper/2610.17343/) (2026)

## Abstract (arXiv)

This paper places conformal testing in a general framework of statistical hypothesis testing. A standard approach to testing a composite null hypothesis H is to test each of its elements and to reject H when each of its elements is rejected. It turns out that we can fully cover conformal testing using this approach only if we allow forgetting some of the data. However, we will see that the standard approach covers conformal testing in a weak asymptotic sense and under restrictive assumptions. I will also list several possible directions of further research, including developing a general scheme of online testing.