Rank-normalization, folding, and localization: An improved widehatR for assessing convergence of MCMC
Not on the map. Why?
Abstract (arXiv)
Markov chain Monte Carlo is a key computational tool in Bayesian statistics, but it can be challenging to monitor the convergence of an iterative stochastic algorithm. In this paper we show that the convergence diagnostic widehatR of Gelman and Rubin (1992) has serious flaws. Traditional widehatR will fail to correctly diagnose convergence failures when the chain has a heavy tail or when the variance varies across the chains. In this paper we propose an alternative rank-based diagnostic that fixes these problems. We also introduce a collection of quantile-based local efficiency measures, along with a practical approach for computing Monte Carlo error estimates for quantiles. We suggest that common trace plots should be replaced with rank plots from multiple chains. Finally, we give recommendations for how these methods should be used in practice.
Key facts. Cited by 90 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 9; 2023: 20; 2024: 16; 2025: 15; 2026: 23.
90 papers.
Sort:
By area:
- 2021Bayesian Neural Network Priors Revisitedcited by 121
- 2021Pathfinder: Parallel quasi-Newton variational inferencecited by 26
- 2023A Primer on Bayesian Neural Networks: Review and Debatescited by 26
- 2025Entropy After </Think> for reasoning model early exitingcited by 24
- 2024Amortized Bayesian Multilevel Modelscited by 12
- 2023A Deep Learning Method for Comparing Bayesian Hierarchical Modelscited by 11
- 2022Enhanced gradient-based MCMC in discrete spacescited by 10
- 2025Microcanonical Langevin Ensembles: Advancing the Sampling of Bayesian Neural Networkscited by 10
- 2023Misspecification-robust Sequential Neural Likelihood for Simulation-based Inferencecited by 8
- 2023Bayesian neural networks via MCMC: a Python-based tutorialcited by 8
- 2023On the Properties and Estimation of Pointwise Mutual Information Profilescited by 7
- 2023Bayesian Hierarchical Models for Counterfactual Estimationcited by 6
38 more
- 2023Ideal Observer Computation by Use of Markov-Chain Monte Carlo with Generative Adversarial Networkscited by 6
- 2023PriorCVAE: scalable MCMC parameter inference with Bayesian deep generative modellingcited by 6
- 2023On the hierarchical Bayesian modelling of frequency response functionscited by 6
- 2025Paths and Ambient Spaces in Neural Loss Landscapescited by 6
- 2021Entropy-based adaptive Hamiltonian Monte Carlocited by 5
- 2021Bounding Wasserstein distance with couplingscited by 5
- 2022Scalable Spike-and-Slabcited by 5
- 2022A fully Bayesian sparse polynomial chaos expansion approach with joint priors on the coefficients and global selection of termscited by 5
- 2023Coreset Markov Chain Monte Carlocited by 5
- 2024Listening to the Noise: Blind Denoising with Gibbs Diffusioncited by 5
- 2024Network reconstruction via the minimum description length principlecited by 5
- 2024Approximately-symmetric neural networks for quantum spin liquidscited by 5
- 2024Simulation-based Inference with the Python Package sbijaxcited by 5
- 2025RefineStat: Efficient Exploration for Probabilistic Program Synthesiscited by 5
- 2022Sparse Gaussian Process Hyperparameters: Optimize or Integrate?cited by 4
- 2023Balanced Training of Energy-Based Models with Adaptive Flow Samplingcited by 4
- 2023Uncertainty Quantification and Propagation in Surrogate-based Bayesian Inferencecited by 4
- 2024Tuning diagonal scale matrices for HMCcited by 4
- 2024RiskLabs: Predicting Financial Risk Using Large Language Model based on Multimodal and Multi-Sources Datacited by 4
- 2023Fast post-process Bayesian inference with Variational Sparse Bayesian Quadraturecited by 3
- 2024Amortized Bayesian Workflowcited by 3
- 2025Posterior SBC: Simulation-Based Calibration Checking Conditional on Datacited by 3
- 2025A Langevin sampling algorithm inspired by the Adam optimizercited by 3
- 2022DPVIm: Differentially Private Variational Inference Improvedcited by 2
- 2023Discriminative calibration: Check Bayesian computation from simulations and flexible classifiercited by 2
- 2025Benchmarking Diffusion Annealing-Based Bayesian Inverse Problem Solverscited by 2
- 2022Bayesian NVH metamodels to assess interior cabin noise using measurement databasescited by 1
- 2022Bayesian nonparametric mixture inconsistency for the number of components: How worried should we be in practice?cited by 1
- 2023An Interpretable Determinantal Choice Model for Subset Selectioncited by 1
- 2023A Targeted Accuracy Diagnostic for Variational Approximationscited by 1
- 2024Fast Bayesian Inference for Neutrino Non-Standard Interactions at Dark Matter Direct Detection Experimentscited by 1
- 2024Symmetry-driven embedding of networks in hyperbolic spacecited by 1
- 2024Multitask learning for improved scour detection: A dynamic wave tank studycited by 1
- 2024Temperature Optimization for Bayesian Deep Learningcited by 1
- 2024ELBOing Stein: Variational Bayes with Stein Mixture Inferencecited by 1
- 2025CoCoAFusE: Beyond Mixtures of Experts via Model Fusioncited by 1
- 2025Uncertainty-Aware Surrogate-based Amortized Bayesian Inference for Computationally Expensive Modelscited by 1
- 2026LLM surprisal is necessary but not sufficient to capture English garden-path effects: Evidence from joint latent modeling of reading paradigmscited by 1
50 most cited of 90 All 90 (JSON)
- 2026BayesNDE: Bayesian Generative Modeling for Neural Density Estimation30 Sep 2026
- 2026Adaptive mixture variational inference for spike-and-slab regression29 Sep 2026
- 2026ViBR-WM: Visual Bayesian Regression for World Modeling27 Sep 2026
- 2026Bayesian Deck-of-cards-based Ordinal Regression with Sequential Preference Elicitation19 Sep 2026
- 2026Quenched Ensemble Sampling14 Sep 2026
- 2026Exact Algebraic Computation of Learning Coefficients for Two-Dimensional Singular Models20 Aug 2026
- 2026Incident-Data Robustness Analysis of the OWASP Top 10 for LLM Applications (2026): How a Community-Expert Ranking Holds Up Against a Large-Scale LLM Incident Corpus18 Aug 2026
- 2026A Ground-Truth Framework for Uncertainty Disentanglement with Posterior Risk6 Aug 2026
- 2026The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity5 Aug 2026
- 2026Distribird: Literature-Informed Prior Distribution Design for Bayesian Model Calibration13 Jul 2026
- 2026Calibration, Not Compilation: Detecting and Repairing Misspecified Probabilistic Programs Written by Language Models30 Jun 2026
- 2026Simulation-based inference for rapid Bayesian parameter estimation in epidemiological models: a comparison with MCMC25 Jun 2026
38 more
- 2026λ-PSD: Scalable Approximate SNR-Optimised Polynomial Stein Discrepancies25 Jun 2026
- 2026Exact Schur-Sylvester Dimensionality Reductions for Non-Smooth Stochastic Complexity and Manifold Sampling22 Jun 2026
- 2026Data assimilation for subsurface flow using latent diffusion model parameterization: performance of ensemble-Kalman and Monte Carlo techniques9 Jun 2026
- 2026Large-scale empirical tuning and comparison of default optimizers for variational inference5 Jun 2026
- 2026Non-Vacuous Certification of Transport MCMC via Oscillation-Controlled Normalizing Flows31 May 2026
- 2026Bayesian Inference of Nonlinear Malaria Dynamics in Ghana via an Ensemble Markov Chain Monte Carlo Sampler30 May 2026
- 2026AI4BayesCode: From Natural Language Descriptions to Validated Modular Stateful Bayesian Samplers18 May 2026
- 2026Stepwise Variational Inference with Vine Copulas24 Mar 2026
- 2026Pareto-Optimal Anytime Algorithms via Bayesian Racing9 Mar 2026
- 2026LLM surprisal is necessary but not sufficient to capture English garden-path effects: Evidence from joint latent modeling of reading paradigms4 Feb 2026
- 2026When Looks Do Not Lie: Discourse Structure Guided In-Context Learning for Faithful Diagram Generation28 Jan 2026
- 2025Probabilistic energy profiler for statically typed JVM-based programming languages2 Dec 2025
- 2025Optimization and Regularization Under Arbitrary Objectives24 Nov 2025
- 2025Enhancing Phenotype Discovery in Electronic Health Records through Prior Knowledge-Guided Unsupervised Learning3 Nov 2025
- 2025Entropy After </Think> for reasoning model early exiting30 Sep 2025
- 2025RefineStat: Efficient Exploration for Probabilistic Program Synthesis1 Sep 2025
- 2025Copula Discrepancy: Benchmarking Dependence Structure29 Jul 2025
- 2025Uncertainty-Aware Surrogate-based Amortized Bayesian Inference for Computationally Expensive Models13 May 2025
- 2025CoCoAFusE: Beyond Mixtures of Experts via Model Fusion2 May 2025
- 2025A Langevin sampling algorithm inspired by the Adam optimizer26 Apr 2025
- 2025Paths and Ambient Spaces in Neural Loss Landscapes5 Mar 2025
- 2025Benchmarking Diffusion Annealing-Based Bayesian Inverse Problem Solvers4 Mar 2025
- 2025Inter-turbine Modelling of Wind-Farm Power using Multi-task Learning20 Feb 2025
- 2025Guided Data Generation for Understanding Model Behavior10 Feb 2025
- 2025Microcanonical Langevin Ensembles: Advancing the Sampling of Bayesian Neural Networks10 Feb 2025
- 2025Posterior SBC: Simulation-Based Calibration Checking Conditional on Data5 Feb 2025
- 2024ELBOing Stein: Variational Bayes with Stein Mixture Inference30 Oct 2024
- 2024Embedded Nonlocal Operator Regression (ENOR): Quantifying model error in learning nonlocal operators27 Oct 2024
- 2024Tuning-Free Coreset Markov Chain Monte Carlo via Hot DoG24 Oct 2024
- 2024Temperature Optimization for Bayesian Deep Learning8 Oct 2024
- 2024Simulation-based Inference with the Python Package sbijax28 Sep 2024
- 2024Amortized Bayesian Workflow6 Sep 2024
- 2024Multitask learning for improved scour detection: A dynamic wave tank study29 Aug 2024
- 2024Amortized Bayesian Multilevel Models23 Aug 2024
- 2024Heterogeneous Treatment Effect Estimation under Noncompliance in the Illinois Workplace Wellness Study with Bayesian Tree Ensembles14 Aug 2024
- 2024Symmetry-driven embedding of networks in hyperbolic space15 Jun 2024
- 2024Approximately-symmetric neural networks for quantum spin liquids27 May 2024
- 2024Fast Bayesian Inference for Neutrino Non-Standard Interactions at Dark Matter Direct Detection Experiments23 May 2024
50 newest of 90 All 90 (JSON)
- 2024Listening to the Noise: Blind Denoising with Gibbs Diffusioncited by 5
- 2025Benchmarking Diffusion Annealing-Based Bayesian Inverse Problem Solverscited by 2
- 2026Data assimilation for subsurface flow using latent diffusion model parameterization: performance of ensemble-Kalman and Monte Carlo techniquescited by 0
- 2026Data assimilation for subsurface flow using latent diffusion model parameterization: performance of ensemble-Kalman and Monte Carlo techniques9 Jun 2026
- 2025Benchmarking Diffusion Annealing-Based Bayesian Inverse Problem Solvers4 Mar 2025
- 2024Listening to the Noise: Blind Denoising with Gibbs Diffusion29 Feb 2024
- 2025Entropy After </Think> for reasoning model early exitingcited by 24
- 2025Entropy After </Think> for reasoning model early exiting30 Sep 2025
- 2025CoCoAFusE: Beyond Mixtures of Experts via Model Fusioncited by 1
- 2025CoCoAFusE: Beyond Mixtures of Experts via Model Fusion2 May 2025
- 2026ViBR-WM: Visual Bayesian Regression for World Modelingcited by 0
- 2026ViBR-WM: Visual Bayesian Regression for World Modeling27 Sep 2026
- 2021Bayesian Neural Network Priors Revisitedcited by 121
- 2021Pathfinder: Parallel quasi-Newton variational inferencecited by 26
- 2023A Primer on Bayesian Neural Networks: Review and Debatescited by 26
- 2024Amortized Bayesian Multilevel Modelscited by 12
- 2023A Deep Learning Method for Comparing Bayesian Hierarchical Modelscited by 11
- 2022Enhanced gradient-based MCMC in discrete spacescited by 10
- 2025Microcanonical Langevin Ensembles: Advancing the Sampling of Bayesian Neural Networkscited by 10
- 2023Misspecification-robust Sequential Neural Likelihood for Simulation-based Inferencecited by 8
- 2023Bayesian neural networks via MCMC: a Python-based tutorialcited by 8
- 2023On the Properties and Estimation of Pointwise Mutual Information Profilescited by 7
- 2023Bayesian Hierarchical Models for Counterfactual Estimationcited by 6
- 2023Ideal Observer Computation by Use of Markov-Chain Monte Carlo with Generative Adversarial Networkscited by 6
12 most cited of 84 All 84 (JSON)
- 2026BayesNDE: Bayesian Generative Modeling for Neural Density Estimation30 Sep 2026
- 2026Adaptive mixture variational inference for spike-and-slab regression29 Sep 2026
- 2026Bayesian Deck-of-cards-based Ordinal Regression with Sequential Preference Elicitation19 Sep 2026
- 2026Quenched Ensemble Sampling14 Sep 2026
- 2026Exact Algebraic Computation of Learning Coefficients for Two-Dimensional Singular Models20 Aug 2026
- 2026Incident-Data Robustness Analysis of the OWASP Top 10 for LLM Applications (2026): How a Community-Expert Ranking Holds Up Against a Large-Scale LLM Incident Corpus18 Aug 2026
- 2026A Ground-Truth Framework for Uncertainty Disentanglement with Posterior Risk6 Aug 2026
- 2026The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity5 Aug 2026
- 2026Distribird: Literature-Informed Prior Distribution Design for Bayesian Model Calibration13 Jul 2026
- 2026Calibration, Not Compilation: Detecting and Repairing Misspecified Probabilistic Programs Written by Language Models30 Jun 2026
- 2026Simulation-based inference for rapid Bayesian parameter estimation in epidemiological models: a comparison with MCMC25 Jun 2026
- 2026λ-PSD: Scalable Approximate SNR-Optimised Polynomial Stein Discrepancies25 Jun 2026
12 newest of 84 All 84 (JSON)