# Simulation-Based Inference via Regression Projection and Batched Discrepancies

arXiv: https://arxiv.org/abs/2602.03613 · HTML: https://mlsanity.com/paper/2602.03613/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 15 of its 53 references that are in the map.
- First posted on arXiv 3 Feb 2026.

## Builds on (most cited first, 15 of 15)

- [The frontier of simulation-based inference](https://mlsanity.com/paper/1911.01429/) (2019)
- [Automatic Posterior Transformation for Likelihood-Free Inference](https://mlsanity.com/paper/1905.07488/) (2019)
- [A General Framework for Updating Belief Distributions](https://mlsanity.com/paper/1306.6430/) (2013)
- [Approximating Likelihood Ratios with Calibrated Discriminative Classifiers](https://mlsanity.com/paper/1506.02169/) (2015)
- [Likelihood-free inference with emulator networks](https://mlsanity.com/paper/1805.09294/) (2018)
- [Learning Robust Statistics for Simulation-based Inference under Model Misspecification](https://mlsanity.com/paper/2305.15871/) (2023)
- [A Trust Crisis In Simulation-Based Inference? Your Posterior Approximations Can Be Unfaithful](https://mlsanity.com/paper/2110.06581/) (2021)
- [Bayesian Indirect Inference Using a Parametric Auxiliary Model](https://mlsanity.com/paper/1505.03372/) (2015)
- [Direct Gibbs posterior inference on risk minimizers: construction, concentration, and calibration](https://mlsanity.com/paper/2203.09381/) (2022)
- [A Comprehensive Guide to Simulation-based Inference in Computational Biology](https://mlsanity.com/paper/2409.19675/) (2024)
- [Cost-aware simulation-based inference](https://mlsanity.com/paper/2410.07930/) (2024)
- [How DREAMS are made: Emulating Satellite Galaxy and Subhalo Populations with Diffusion Models and Point Clouds](https://mlsanity.com/paper/2409.02980/) (2024)
- [Embed and Emulate: Contrastive representations for simulation-based inference](https://mlsanity.com/paper/2409.18402/) (2024)
- [ABC and Indirect Inference](https://mlsanity.com/paper/1803.01999/) (2018)
- [Bayesian Computational Tools](https://mlsanity.com/paper/1304.2048/) (2013)

## Abstract (arXiv)

We analyze a lightweight simulation-based inference method that infers simulator parameters using only a regression-based projection of the observed data. After fitting a surrogate linear regression once, the procedure simulates small batches at the proposed parameter values and assigns kernel weights based on the resulting batch-residual discrepancy, producing a self-normalized pseudo-posterior that is simple, parallelizable, and requires access only to the fitted regression coefficients rather than raw observations. We formalize the construction as an importance-sampling approximation to a population target that averages over simulator randomness, prove consistency as the number of parameter draws grows, and establish stability in estimating the surrogate regression from finite samples. We then characterize the asymptotic concentration as the batch size increases and the bandwidth shrinks, showing that the pseudo-posterior concentrates on an identified set determined by the chosen projection, thereby clarifying when the method yields point versus set identification. Experiments on a tractable nonlinear model and on a cosmological calibration task using the DREAMS simulation suite illustrate the computational advantages of regression-based projections and the identifiability limitations arising from low-information summaries.
