FARM: Reading Failure Signals from the Internal Predictive States of a Frozen Robotic World Model
On the map: World models → Latent dynamics models and model-based RL
Abstract (arXiv)
Reliable robot deployment requires online failure monitoring, yet existing monitors mainly derive risk from proxy signals or train dedicated monitoring components. We ask whether the internal predictive states of a frozen pretrained robotic world model already contain directly decodable failure information. Failure-Aware Readout from World Models (FARM) trains only a 33,985-parameter supervised readout over frozen VLA-JEPA predictive states, producing step-wise failure scores and causal trajectory risk. Five-fold out-of-fold evaluation across seven source tasks reaches 85.68/88.59 pooled AUROC/AUPRC, and FARM gives the best Seen performance among 15 matched baselines on the 10-task benchmark. Across four real-robot populations on PIPER X, SO-101, and Franka, fixed-readout transfer and readout-only adaptation test deployment shifts without updating the predictive backbone. FARM also discriminates failures from partial causal histories and adds 0.2256 ms mean CUDA latency once the frozen state is available. These results support frozen predictive world-model states as reusable features for causal, transferable, and low-overhead execution monitoring.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Latent dynamics models and model-based RL, one of 11 directions in World models. Builds on 12 of its 31 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
12 of 31 references.
Closest ancestors · 2
Same direction, newest first
- 2026Foundational World Models Accurately Detect Bimanual Manipulator Failures7 Mar
- 2018World Models27 Mar
Other references · 10
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2025π*0.6: a VLA That Learns From Experiencecited by 303
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 118
- 2023Model-Based Runtime Monitoring with Interactive Imitation Learningcited by 38
- 2026Foresight: Failure Detection for Long-Horizon Robotic Manipulation with Action-Conditioned World Model Latentscited by 11
- 2026Failure Detection for Surgical Robot Imitation Policies via Flow-Matching World Modelingcited by 3
- 2026ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Modelscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026World Models Dream of Success: Diagnosing and Repairing Failure Insensitivity in Robot World Models
- 2026ReAP: From Visual Failure Recognition to Action-Conditioned Risk Prediction for Runtime Failure Monitoring
- 2025Failure Prediction at Runtime for Generative Robot Policies
- 2026MiraBench: Evaluating Action-Conditioned Reliability in Robotic World Models
- 2025Can We Detect Failures Without Failure Data? Uncertainty-Aware Runtime Failure Detection for Imitation Learning Policies
- 2026FATE-VLA:Failue-aware test generation for vision-language-action models
- 2026FAR: Failure-Aware Retry for Test-Time Recovery and Continual Policy Improvement
- 2026When World Models Lie: Adaptive Safety Analysis Under Wrong Imaginations