Validation-Frontier Representation Selection under Constrained Observation
Not on the map. Why?
Abstract (arXiv)
AI systems deployed outside clean benchmark settings often rely on observations that are incomplete, unstable, costly, or degraded by monitoring failures. This paper studies representation selection under constrained observation: choosing a state representation when raw accuracy is not the only operational criterion. We propose a validation-frontier selector that combines balanced accuracy with penalties for feature cost, overfit gap, and validation-test instability. In a focused public-tabular benchmark using three scikit-learn datasets, five observation regimes, 45 matched task cells, 720 candidate actions, and 405 representation rows, the adaptive selector improves frontier score over full trace features by 0.025801 while reducing mean feature count by 22.733. Balanced-accuracy difference is small and not statistically significant. A broader offline stress test gives mixed results. The supported claim is therefore bounded: adaptive representation selection can improve a constrained-observation robustness-efficiency frontier in matched benchmark settings, but does not universally dominate trace baselines.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 23 references that are in the map. First posted on arXiv 15 Aug 2026.
Builds on
9 of 23 references.
References · 9
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2020Shortcut Learning in Deep Neural Networkscited by 1,969
- 2016Concrete Problems in AI Safetycited by 1,642
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2020In Search of Lost Domain Generalizationcited by 1,054
- 2016Deep Variational Information Bottleneckcited by 930
Built on by
Not cited yet.