# Truncated Marginal Neural Ratio Estimation

arXiv: https://arxiv.org/abs/2107.01214 · HTML: https://mlsanity.com/paper/2107.01214/

## Key facts

- Cited by 30 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 77 references that are in the map.
- First posted on arXiv 2 Jul 2021.

## Builds on (most cited first, 24 of 24)

- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distances](https://mlsanity.com/paper/1306.0895/) (2013)
- [Normalizing Flows for Probabilistic Modeling and Inference](https://mlsanity.com/paper/1912.02762/) (2019)
- [Masked Autoregressive Flow for Density Estimation](https://mlsanity.com/paper/1705.07057/) (2017)
- [The frontier of simulation-based inference](https://mlsanity.com/paper/1911.01429/) (2019)
- [Revisiting Classifier Two-Sample Tests](https://mlsanity.com/paper/1610.06545/) (2016)
- [Sequential Neural Likelihood: Fast Likelihood-free Inference with Autoregressive Flows](https://mlsanity.com/paper/1805.07226/) (2018)
- [Automatic Posterior Transformation for Likelihood-Free Inference](https://mlsanity.com/paper/1905.07488/) (2019)
- [Flexible statistical inference for mechanistic models of neural dynamics](https://mlsanity.com/paper/1711.01861/) (2017)
- [Benchmarking Simulation-Based Inference](https://mlsanity.com/paper/2101.04653/) (2021)
- [Learning in Implicit Generative Models](https://mlsanity.com/paper/1610.03483/) (2016)
- [On Contrastive Learning for Likelihood-free Inference](https://mlsanity.com/paper/2002.03712/) (2020)
- [Approximating Likelihood Ratios with Calibrated Discriminative Classifiers](https://mlsanity.com/paper/1506.02169/) (2015)
- [Likelihood-free inference by ratio estimation](https://mlsanity.com/paper/1611.10242/) (2016)
- [Real-time gravitational-wave science with neural posterior estimation](https://mlsanity.com/paper/2106.12594/) (2021)
- [Bayesian Optimization for Likelihood-Free Inference of Simulator-Based Statistical Models](https://mlsanity.com/paper/1501.03291/) (2015)
- [Likelihood-free inference with emulator networks](https://mlsanity.com/paper/1805.09294/) (2018)
- [Fast ε-free Inference of Simulation Models with Bayesian Conditional Density Estimation](https://mlsanity.com/paper/1605.06376/) (2016)
- [Constraining Effective Field Theories with Machine Learning](https://mlsanity.com/paper/1805.00013/) (2018)
- [Solving high-dimensional parameter inference: marginal posterior densities & Moment Networks](https://mlsanity.com/paper/2011.05991/) (2020)
- [Dynamic nested sampling: an improved algorithm for parameter estimation and evidence calculation](https://mlsanity.com/paper/1704.03459/) (2017)
- [Towards constraining warm dark matter with stellar streams through neural simulation-based inference](https://mlsanity.com/paper/2011.14923/) (2020)
- [Simulation-efficient marginal posterior estimation with swyft: stop wasting your precious time](https://mlsanity.com/paper/2011.13951/) (2020)
- [A method for comparing non-nested models with application to astrophysical searches for new physics](https://mlsanity.com/paper/1509.01010/) (2015)

## Built on by (most cited first, 30 of 30)

- [Sequential Neural Score Estimation: Likelihood-Free Inference with Conditional Score Based Diffusion Models](https://mlsanity.com/paper/2210.04872/) (2022)
- [Variational methods for simulation-based inference](https://mlsanity.com/paper/2203.04176/) (2022)
- [Truncated proposals for scalable and hassle-free simulation-based inference](https://mlsanity.com/paper/2210.04815/) (2022)
- [Neural Methods for Amortized Inference](https://mlsanity.com/paper/2404.12484/) (2024)
- [Geometric Clifford Algebra Networks](https://mlsanity.com/paper/2302.06594/) (2023)
- [BayesFlow: Amortized Bayesian Workflows With Neural Networks](https://mlsanity.com/paper/2306.16015/) (2023)
- [Towards Reliable Simulation-Based Inference with Balanced Neural Ratio Estimation](https://mlsanity.com/paper/2208.13624/) (2022)
- [Fast and Credible Likelihood-Free Cosmology with Truncated Marginal Neural Ratio Estimation](https://mlsanity.com/paper/2111.08030/) (2021)
- [Balancing Simulation-based Inference for Conservative Posteriors](https://mlsanity.com/paper/2304.10978/) (2023)
- [Multifidelity Simulation-based Inference for Computationally Expensive Simulators](https://mlsanity.com/paper/2502.08416/) (2025)
- [Contrastive Neural Ratio Estimation for Simulation-based Inference](https://mlsanity.com/paper/2210.06170/) (2022)
- [Arbitrary Marginal Neural Ratio Estimation for Simulation-based Inference](https://mlsanity.com/paper/2110.00449/) (2021)
- [Simulation-Based Inference with Quantile Regression](https://mlsanity.com/paper/2401.02413/) (2024)
- [Tests for model misspecification in simulation-based inference: from local distortions to global model checks](https://mlsanity.com/paper/2412.15100/) (2024)
- [Simulation-based Inference with the Generalized Kullback-Leibler Divergence](https://mlsanity.com/paper/2310.01808/) (2023)
- [Embed and Emulate: Contrastive representations for simulation-based inference](https://mlsanity.com/paper/2409.18402/) (2024)
- [Improving the Accuracy of Marginal Approximations in Likelihood-Free Inference via Localisation](https://mlsanity.com/paper/2207.06655/) (2022)
- [Simulation-based inference for stochastic nonlinear mixed-effects models with applications in systems biology](https://mlsanity.com/paper/2504.11279/) (2025)
- [Extracting the gamma-ray source-count distribution below the Fermi-LAT detection limit with deep learning](https://mlsanity.com/paper/2302.01947/) (2023)
- [Fishnets: Information-Optimal, Scalable Aggregation for Sets and Graphs](https://mlsanity.com/paper/2310.03812/) (2023)
- [Simulation-based population inference of LISA's Galactic binaries: Bypassing the global fit](https://mlsanity.com/paper/2506.22543/) (2025)
- [Trustworthy scientific inference with generative models](https://mlsanity.com/paper/2508.02602/) (2025)
- [Conditional Neural Bayes Ratio Estimation for Experimental Design Optimisation](https://mlsanity.com/paper/2603.26489/) (2026)
- [Cosmology with Persistent Homology: Parameter Inference via Machine Learning](https://mlsanity.com/paper/2412.15405/) (2024)
- [Recent Advances in Simulation-based Inference for Gravitational Wave Data Analysis](https://mlsanity.com/paper/2507.11192/) (2025)
- [CIGaRS I: Combined simulation-based inference from type Ia supernovae and host photometry](https://mlsanity.com/paper/2508.15899/) (2025)
- [Keeping Score: Adaptive, Tuning-Free Loss Weighting for Score-Augmented Neural Ratio Estimation](https://mlsanity.com/paper/2605.12118/) (2026)
- [Program Synthesis for Simulation-Based Inference: Joint Model Selection and Parameter Estimation](https://mlsanity.com/paper/2607.17540/) (2026)
- [Posterior Inference of Hamiltonian Parameters from RIXS Spectroscopy](https://mlsanity.com/paper/2608.13848/) (2026)
- [Amortized ratio-estimation importance sampling and localized simulation-based calibration for intractable likelihoods](https://mlsanity.com/paper/2609.39712/) (2026)

## Abstract (arXiv)

Parametric stochastic simulators are ubiquitous in science, often featuring high-dimensional input parameters and/or an intractable likelihood. Performing Bayesian parameter inference in this context can be challenging. We present a neural simulation-based inference algorithm which simultaneously offers simulation efficiency and fast empirical posterior testability, which is unique among modern algorithms. Our approach is simulation efficient by simultaneously estimating low-dimensional marginal posteriors instead of the joint posterior and by proposing simulations targeted to an observation of interest via a prior suitably truncated by an indicator function. Furthermore, by estimating a locally amortized posterior our algorithm enables efficient empirical tests of the robustness of the inference results. Since scientists cannot access the ground truth, these tests are necessary for trusting inference in real-world applications. We perform experiments on a marginalized version of the simulation-based inference benchmark and two complex and narrow posteriors, highlighting the simulator efficiency of our algorithm as well as the quality of the estimated marginal posteriors.
