DEEDEE: Fast and Scalable Out-of-Distribution Dynamics Detection
Not on the map. Why?
Abstract (arXiv)
Deploying reinforcement learning (RL) in safety-critical settings is constrained by brittleness under distribution shift. We study out-of-distribution (OOD) detection for RL time series and introduce DEEDEE, a two-statistic detector that revisits representation-heavy pipelines with a minimal alternative. DEEDEE uses only an episodewise mean and an RBF kernel similarity to a training summary, capturing complementary global and local deviations. Despite its simplicity, DEEDEE matches or surpasses contemporary detectors across standard RL OOD suites, delivering a 600-fold reduction in compute (FLOPs / wall-time) and an average 5% absolute accuracy gain over strong baselines. Conceptually, our results indicate that diverse anomaly types often imprint on RL trajectories through a small set of low-order statistics, suggesting a compact foundation for OOD detection in complex environments.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 24 Oct 2025.
Builds on
12 of 22 references.
References · 12
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2015Trust Region Policy Optimizationcited by 2,503
- 2018Learning Dexterous In-Hand Manipulationcited by 643
- 2025Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agentscited by 66
- 2019Measuring the Reliability of Reinforcement Learning Algorithmscited by 49
- 2020High-dimensional, multiscale online changepoint detectioncited by 19
- 2024Rethinking Out-of-Distribution Detection for Reinforcement Learning: Advancing Methods for Evaluation and Detectioncited by 17
- 2019Uncertainty-Based Out-of-Distribution Classification in Deep Reinforcement Learningcited by 15
- 2021Out-of-Distribution Dynamics Detection: RL-Relevant Benchmarks and Resultscited by 14
- 2021Benchmark for Out-of-Distribution Detection in Deep Reinforcement Learningcited by 9
- 2025Guaranteeing Out-Of-Distribution Detection in Deep RL via Transition Estimationcited by 6
Built on by
Not cited yet.