Augmented Inverse Hybrid Weighting: Robust Inference under Deterministic and Random Distribution Shifts
Not on the map. Why?
Abstract (arXiv)
Reweighting source samples to match a target covariate distribution is a standard response to distribution shift when generalizing evidence from one population to another. This strategy is well suited to deterministic, learnable covariate discrepancies, but can be insufficient when source--target population differences also contain changes beyond covariate shift or when estimation of the density-ratio weights is unstable. To address this challenge, we introduce a new model that allows non-systematic changes between two population laws after systematic shifts are accounted for. Such residual shift is modeled as random perturbations to the probability space that cannot be represented in a learnable way. In this way, we separate systematic shifts, treated as bias and corrected by reweighting, from residual random perturbations, treated as distributional uncertainty and handled through dataset pooling. Under pure random perturbations, this principle yields Augmented Inverse Distance Weighting (AIDW), which uses regression augmentation and variance-optimal dataset-level pooling. For mixed shifts, we develop Augmented Inverse Hybrid Weighting (AIHW), which interpolates between AIDW and standard augmented importance weighting. Both methods trade off sampling uncertainty and distributional uncertainty via a distributional distance that describes the strength of random perturbations. We establish asymptotic properties of the methods, together with plug-in guidance for choosing tuning parameters and model diagnostic tools. Experiments on three real-world multi-site datasets demonstrate consistent reductions in mean-squared error compared with standard weighting baselines, along with substantially improved empirical coverage in settings where covariate-shift adjustment alone undercovers, showing the robustness of the proposed methods across diverse distribution shift scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 36 references that are in the map. First posted on arXiv 1 Aug 2026.
Builds on
14 of 36 references.
References · 14
- 2021Retiring Adult: New Datasets for Fair Machine Learningcited by 443
- 2018Learning Models with Uniform Performance via Distributionally Robust Optimizationcited by 334
- 2023Diagnosing Model Performance Under Distribution Shiftcited by 37
- 2021A Review of Generalizability and Transportabilitycited by 36
- 2017Generalizing causal inferences from individuals in randomized trials to all trial-eligible individualscited by 24
- 2018Extending inferences from a randomized trial to a new target populationcited by 19
- 2017Minimal Dispersion Approximately Balancing Weights: Asymptotic Properties and Practical Considerationscited by 18
- 2023Learning under random distributional shiftscited by 6
- 2022Calibrated inference: statistical inference that accounts for both sampling uncertainty and distributional uncertaintycited by 5
- 2024Out-of-distribution generalization under random, dense distributional shiftscited by 5
- 2019Covariate Selection for Generalizing Experimental Results: Application to Large-Scale Development Program in Ugandacited by 4
- 2021On the implied weights of linear regression for causal inferencecited by 3
Built on by
Not cited yet.