# Graphical Test for Discrete Uniformity and its Applications in Goodness of Fit Evaluation and Multiple Sample Comparison

arXiv: https://arxiv.org/abs/2103.10522 · HTML: https://mlsanity.com/paper/2103.10522/

## Key facts

- Cited by 26 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Mar 2021.

## Built on by (most cited first, 26 of 26)

- [Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networks](https://mlsanity.com/paper/2112.08866/) (2021)
- [JANA: Jointly Amortized Neural Approximation of Complex Bayesian Models](https://mlsanity.com/paper/2302.09125/) (2023)
- [BayesFlow: Amortized Bayesian Workflows With Neural Networks](https://mlsanity.com/paper/2306.16015/) (2023)
- [Amortized Probabilistic Conditioning for Optimization, Simulation and Inference](https://mlsanity.com/paper/2410.15320/) (2024)
- [Sensitivity-Aware Amortized Bayesian Inference](https://mlsanity.com/paper/2310.11122/) (2023)
- [Leveraging Self-Consistency for Data-Efficient Amortized Bayesian Inference](https://mlsanity.com/paper/2310.04395/) (2023)
- [Amortized Bayesian Multilevel Models](https://mlsanity.com/paper/2408.13230/) (2024)
- [BayesFlow 2: Multi-Backend Amortized Bayesian Inference in Python](https://mlsanity.com/paper/2602.07098/) (2026)
- [Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networks: An Extended Investigation](https://mlsanity.com/paper/2406.03154/) (2024)
- [Neural Superstatistics for Bayesian Estimation of Dynamic Cognitive Models](https://mlsanity.com/paper/2211.13165/) (2022)
- [Uncertainty Quantification and Propagation in Surrogate-based Bayesian Inference](https://mlsanity.com/paper/2312.05153/) (2023)
- [Simulation-Based Inference with Quantile Regression](https://mlsanity.com/paper/2401.02413/) (2024)
- [Amortized Bayesian Workflow](https://mlsanity.com/paper/2409.04332/) (2024)
- [Posterior SBC: Simulation-Based Calibration Checking Conditional on Data](https://mlsanity.com/paper/2502.03279/) (2025)
- [ConDiSim: Conditional Diffusion Models for Simulation Based Inference](https://mlsanity.com/paper/2505.08403/) (2025)
- [From Mice to Trains: Amortized Bayesian Inference on Graph Data](https://mlsanity.com/paper/2601.02241/) (2026)
- [Uncertainty-Aware Surrogate-based Amortized Bayesian Inference for Computationally Expensive Models](https://mlsanity.com/paper/2505.08683/) (2025)
- [Microstructure-based Variational Neural Networks for Robust Uncertainty Quantification in Materials Digital Twins](https://mlsanity.com/paper/2512.18104/) (2025)
- [Recipes for Calibration Checks in Safety-Critical Applications](https://mlsanity.com/paper/2604.26479/) (2026)
- [An Introduction to Bayesian and Frequentist Simulation-Based Inference with Machine Learning](https://mlsanity.com/paper/2607.21702/) (2026)
- [Identifiability and amortized inference limitations in Kuramoto models](https://mlsanity.com/paper/2603.21752/) (2026)
- [Conservative neural posterior estimation via distributionally robust training](https://mlsanity.com/paper/2605.28516/) (2026)
- [On the approximation of posterior laws in compound loss models by conditional Wasserstein GANs](https://mlsanity.com/paper/2608.27229/) (2026)
- [Recovery-Directed Symbolic Distillation of Neural Likelihoods](https://mlsanity.com/paper/2609.32409/) (2026)
- [High-Dimensional Simulation-Based Inference in Latent Spaces](https://mlsanity.com/paper/2609.37381/) (2026)
- [Amortized ratio-estimation importance sampling and localized simulation-based calibration for intractable likelihoods](https://mlsanity.com/paper/2609.39712/) (2026)

## Abstract (arXiv)

Assessing goodness of fit to a given distribution plays an important role in computational statistics. The Probability integral transformation (PIT) can be used to convert the question of whether a given sample originates from a reference distribution into a problem of testing for uniformity. We present new simulation and optimization based methods to obtain simultaneous confidence bands for the whole empirical cumulative distribution function (ECDF) of the PIT values under the assumption of uniformity. Simultaneous confidence bands correspond to such confidence intervals at each point that jointly satisfy a desired coverage. These methods can also be applied in cases where the reference distribution is represented only by a finite sample. The confidence bands provide an intuitive ECDF-based graphical test for uniformity, which also provides useful information on the quality of the discrepancy. We further extend the simulation and optimization methods to determine simultaneous confidence bands for testing whether multiple samples come from the same underlying distribution. This multiple sample comparison test is especially useful in Markov chain Monte Carlo convergence diagnostics. We provide numerical experiments to assess the properties of the tests using both simulated and real world data and give recommendations on their practical application in computational statistics workflows.