mlsanityData to 14 Oct 2026

When Does Test-Time Physical Diagnosis Pay? A Frozen Policy Buys Evidence It Never Reads

arXiv 2609.22299 ↗First posted 14 Sep 2026cs.RO cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

When a robot faces unfamiliar physical conditions, a common approach is to collect evidence about what changed and adapt. For such diagnosis to improve behavior, six ordered empirical conditions must hold: a meaningful reference, identifiability of the physical condition, use of the acquired evidence, decision value, selection value over a fixed alternative, and safe realization. We test this chain in controlled and public environments. It holds end to end in our controlled environments. After transfer to unseen mechanisms, however, it breaks at evidence use. On decisions requiring the full trace, the frozen decoder does not change its choice. A linear model using only trace increments recovers the correct choice on mechanisms excluded from fitting, showing that the trace is informative but unused. The failure is concentrated at the richest evidence level: those decisions fall to chance, while decisions settled with lower-cost evidence remain correct, a split hidden by aggregate accuracy. The same chain can fail at other links in public environments. Successful physical identification therefore guarantees neither evidence use nor useful adaptation; evaluation should identify where the chain breaks rather than rely on recovery accuracy or aggregate performance alone.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 33 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

31 of 33 references.

References · 31

  1. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  2. 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 350
  3. 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
  4. 2019VariBAD: A Very Good Method for Bayes-Adaptive Deep RL via Meta-Learningcited by 217
  5. 2025RoboArena: Distributed Real-World Evaluation of Generalist Robot Policiescited by 64
  6. 2025PolaRiS: Scalable Real-to-Sim Evaluations for Generalist Robot Policiescited by 33
  7. 2025RoboEval: Where Robotic Manipulation Meets Structured and Scalable Evaluationcited by 32
  8. 2017Robust and Efficient Transfer Learning with Hidden-Parameter Markov Decision Processescited by 29
  9. 2024ASID: Active Exploration for System Identification in Robotic Manipulationcited by 28
  10. 2024ODRL: A Benchmark for Off-Dynamics Reinforcement Learningcited by 25
  11. 2026RoboLab: A High-Fidelity Simulation Benchmark for Analysis of Task Generalist Policiescited by 24
  12. 2023Acquisition Conditioned Oracle for Nongreedy Active Feature Acquisitioncited by 19
19 more
  1. 2025A Survey on Active Feature Acquisition Strategiescited by 17
  2. 2025A Taxonomy for Evaluating Generalist Robot Manipulation Policiescited by 16
  3. 2020Fast Adaptation via Policy-Dynamics Value Functionscited by 13
  4. 2020Learning Active Task-Oriented Exploration Policies for Bridging the Sim-to-Real Gapcited by 11
  5. 2023Evaluation of Active Feature Acquisition Methods for Time-varying Feature Settingscited by 9
  6. 2025AFABench: A Generic Framework for Benchmarking Active Feature Acquisitioncited by 9
  7. 2025Zero-Shot Adaptation of Behavioral Foundation Models to Unseen Dynamicscited by 8
  8. 2026What Are We Actually Benchmarking in Robot Manipulation?cited by 7
  9. 2018Value of Information in Feedback Control: Quantificationcited by 6
  10. 2025Robot Policy Evaluation for Sim-to-Real Transfer: A Benchmarking Perspectivecited by 5
  11. 2025Dynamics-Aligned Latent Imagination in Contextual World Models for Zero-Shot Generalizationcited by 5
  12. 2025Learning-To-Measure: In-Context Active Feature Acquisitioncited by 5
  13. 2021Adaptive control of a mechatronic system using constrained residual reinforcement learningcited by 2
  14. 2025Poke and Strike: Learning Task-Informed Exploration Policiescited by 2
  15. 2026A Statistical Test for the Benefits of Personalizing Interventionscited by 2
  16. 2025NOCTA: Non-Greedy Objective Cost-Tradeoff Acquisition for Longitudinal Datacited by 1
  17. 2026Decision-Focused Learning: When and Why Traditional Prediction Models Failcited by 1
  18. 2026Active Real-World Factor-Based Evaluation for Generalist Robot Policiescited by 1
  19. 2026When Is a Learned Command Adapter Worth It? Closed-Loop Identification and Counterfactual Auditing of Frozen Locomotion Policiescited by 1

Built on by

Not cited yet.