RAPT: Model-Predictive Out-of-Distribution Detection and Failure Diagnosis for Sim-to-Real Humanoid Deployment
Not on the map. Why?
Abstract (arXiv)
Deploying learned control policies is risky because policies that appear robust in simulation can confidently enter out-of-distribution (OOD) states after Sim-to-Real transfer, causing silent failures and potential hardware damage. Existing anomaly detectors often fail to meet the requirements of high-rate control, extremely low false-positive rates, and interpretable failure feedback. We present RAPT (Recurrent Anomaly Probabilistic Trajectory Model), a lightweight, self-supervised 50,Hz deployment monitor that learns nominal execution from large-scale simulation and produces calibrated, per-dimension predictive-deviation signals online. RAPT enables OOD detection under strict false-positive constraints while localizing when and where real execution departs from nominal behavior. For post-hoc diagnosis, RAPT combines temporal saliency, joint-kinematic summaries, and LLM-based semantic reasoning to classify likely failure causes in a zero-shot setting. In simulation across four Isaac Lab tasks, RAPT improves TPR by 37% over the strongest baseline at 0.5% episode-level FPR; on hardware, it achieves 89% TPR across 78 trials with fewer false positives than high-frequency-compatible baselines, and reaches 75% semantic failure diagnosis accuracy across 21 categories on a challenging OOD subset. Project website, code, and videos: https://humphreymunn.github.io/RAPT/.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 20 references that are in the map. First posted on arXiv 2 Feb 2026.
Builds on
15 of 20 references.
References · 15
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2017Safe Reinforcement Learning via Shieldingcited by 427
- 2017Safe Model-based Reinforcement Learning with Stability Guaranteescited by 347
- 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 337
- 2019End-to-End Safe Reinforcement Learning through Barrier Functions for Safety-Critical Continuous Control Taskscited by 256
- 2017A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-based Variational Autoencodercited by 209
- 2019Lyapunov-based Safe Policy Optimization for Continuous Controlcited by 140
- 2025Can We Detect Failures Without Failure Data? Uncertainty-Aware Runtime Failure Detection for Imitation Learning Policiescited by 49
- 2024Rethinking Out-of-Distribution Detection for Reinforcement Learning: Advancing Methods for Evaluation and Detectioncited by 17
- 2024PatchAD: A Lightweight Patch-based MLP-Mixer for Time Series Anomaly Detectioncited by 12
- 2021Benchmark for Out-of-Distribution Detection in Deep Reinforcement Learningcited by 9
- 2025Guaranteeing Out-Of-Distribution Detection in Deep RL via Transition Estimationcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Failure Identification in Imitation Learning Via Statistical and Semantic Filtering
- 2024Real-Time Anomaly Detection and Reactive Planning with Large Language Models
- 2026Continuous Online Fault Detection for Mobile Robots via Adaptive Edge Models
- 2026Foresight: Failure Detection for Long-Horizon Robotic Manipulation with Action-Conditioned World Model Latents
- 2026Hide-and-Seek in Trajectories: Discovering Failure Signals for VLA Runtime Monitoring
- 2026ROBOGATE: Adaptive Failure Discovery for Safe Robot Policy Deployment via Two-Stage Boundary-Focused Sampling ↗
- 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progress
- 2025Failure Prediction at Runtime for Generative Robot Policies