mlsanityData to 7 Oct 2026

Environment-Conditioned Tail Reweighting for Invariant Learning under Mixed Shifts

arXiv 2601.22944 ↗First posted 30 Jan 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Out-of-distribution generalization becomes challenging when spurious correlations vary across environments while difficult or underrepresented samples remain insufficiently emphasized within them. Invariant learning and reweighting address complementary aspects of this mixed-shift problem, yet applying reweighting only to prediction leaves the invariance constraint evaluated on a different training risk. We introduce Environment-Conditioned Tail Reweighting (ECTR), which couples cross-environment TV invariance with within-environment adversarial tail weighting through a shared weighted risk. Sample weights are normalized within each environment, and the resulting risk is used consistently for both predictive learning and the total-variation (TV) stationarity penalty, while an environment-wise KL term controls adversarial concentration. Our analysis characterizes the stationarity-dependent weighting signal and its KL-regularized distributional interpretation, alongside conditional-risk and optimization properties under the stated assumptions. Controlled mixed-shift ablations consistently support the shared-risk coupling across three difficulty settings. Across synthetic and real-world benchmarks, ECTR achieves favorable results under both observed- and inferred-environment settings, including improvements over TV-based parent methods and strong performance against additional invariant-learning baselines. Training-corruption experiments further show that ECTR assigns less excess weight to corrupted samples than the tested fixed-tail rules. Together, these results provide a unified theoretical and empirical account of environment-conditioned tail reweighting for invariant learning under mixed shifts.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 30 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

24 of 30 references.

References · 24

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  3. 2019Invariant Risk Minimizationcited by 1,832
  4. 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,232
  5. 2020In Search of Lost Domain Generalizationcited by 1,042
  6. 2017Deeper, Broader and Artier Domain Generalizationcited by 983
  7. 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
  8. 2021Just Train Twice: Improving Group Robustness without Training Group Informationcited by 522
  9. 2018Learning Models with Uniform Performance via Distributionally Robust Optimizationcited by 334
  10. 2020Environment Inference for Invariant Learningcited by 306
  11. 2020Invariant Risk Minimization Gamescited by 188
  12. 2021Deep Stable Learning for Out-Of-Distribution Generalizationcited by 153
12 more
  1. 2021Heterogeneous Risk Minimizationcited by 90
  2. 2021OoD-Bench: Quantifying and Understanding Two Dimensions of Out-of-Distribution Generalizationcited by 86
  3. 2022NICO++: Towards Better Benchmarking for Domain Generalizationcited by 86
  4. 2019Stable Learning via Sample Reweightingcited by 70
  5. 2022ZIN: When and How to Learn Invariance Without Environment Partition?cited by 58
  6. 2020In-N-Out: Pre-Training and Self-Training using Auxiliary Information for Out-of-Distribution Robustnesscited by 49
  7. 2023Model Agnostic Sample Reweighting for Out-of-Distribution Learningcited by 43
  8. 2023Discovering environments with XRMcited by 26
  9. 2023Domain Generalisation via Risk Distribution Matchingcited by 14
  10. 2024Invariant Risk Minimization Is A Total Variation Modelcited by 5
  11. 2025Out-of-distribution Generalization for Total Variation based Invariant Risk Minimizationcited by 3
  12. 2024Weighted Risk Invariance: Domain Generalization under Invariant Feature Shiftcited by 2

Built on by

Not cited yet.