Environment-Conditioned Tail Reweighting for Invariant Learning under Mixed Shifts
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution generalization becomes challenging when spurious correlations vary across environments while difficult or underrepresented samples remain insufficiently emphasized within them. Invariant learning and reweighting address complementary aspects of this mixed-shift problem, yet applying reweighting only to prediction leaves the invariance constraint evaluated on a different training risk. We introduce Environment-Conditioned Tail Reweighting (ECTR), which couples cross-environment TV invariance with within-environment adversarial tail weighting through a shared weighted risk. Sample weights are normalized within each environment, and the resulting risk is used consistently for both predictive learning and the total-variation (TV) stationarity penalty, while an environment-wise KL term controls adversarial concentration. Our analysis characterizes the stationarity-dependent weighting signal and its KL-regularized distributional interpretation, alongside conditional-risk and optimization properties under the stated assumptions. Controlled mixed-shift ablations consistently support the shared-risk coupling across three difficulty settings. Across synthetic and real-world benchmarks, ECTR achieves favorable results under both observed- and inferred-environment settings, including improvements over TV-based parent methods and strong performance against additional invariant-learning baselines. Training-corruption experiments further show that ECTR assigns less excess weight to corrupted samples than the tested fixed-tail rules. Together, these results provide a unified theoretical and empirical account of environment-conditioned tail reweighting for invariant learning under mixed shifts.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 30 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
24 of 30 references.
References · 24
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Deep Learning Face Attributes in the Wildcited by 3,679
- 2019Invariant Risk Minimizationcited by 1,832
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
- 2020In Search of Lost Domain Generalizationcited by 1,042
- 2017Deeper, Broader and Artier Domain Generalizationcited by 983
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
- 2021Just Train Twice: Improving Group Robustness without Training Group Informationcited by 522
- 2018Learning Models with Uniform Performance via Distributionally Robust Optimizationcited by 334
- 2020Environment Inference for Invariant Learningcited by 306
- 2020Invariant Risk Minimization Gamescited by 188
- 2021Deep Stable Learning for Out-Of-Distribution Generalizationcited by 153
12 more
- 2021Heterogeneous Risk Minimizationcited by 90
- 2021OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalizationcited by 86
- 2022NICO++: Towards Better Benchmarking for Domain Generalizationcited by 86
- 2019Stable Learning via Sample Reweightingcited by 70
- 2022ZIN: When and How to Learn Invariance Without Environment Partition?cited by 58
- 2020In-N-Out: Pre-Training and Self-Training using Auxiliary Information for Out-of-Distribution Robustnesscited by 49
- 2023Model Agnostic Sample Reweighting for Out-of-Distribution Learningcited by 43
- 2023Discovering environments with XRMcited by 26
- 2023Domain Generalisation via Risk Distribution Matchingcited by 14
- 2024Invariant Risk Minimization Is A Total Variation Modelcited by 5
- 2025Out-of-distribution Generalization for Total Variation based Invariant Risk Minimizationcited by 3
- 2024Weighted Risk Invariance: Domain Generalization under Invariant Feature Shiftcited by 2
Built on by
Not cited yet.