TRIAGE: Type-Routed Interventions via Aleatoric-Epistemic Gated Estimation in Robotic Manipulation and Adaptive Perception -- Don't Treat All Uncertainty the Same
Not on the map. Why?
Abstract (arXiv)
Most uncertainty-aware robotic systems collapse prediction uncertainty into a single scalar score and use it to trigger uniform corrective responses. This aggregation obscures whether uncertainty arises from corrupted observations or from mismatch between the learned model and the true system dynamics. As a result, corrective actions may be applied to the wrong component of the closed loop, degrading performance relative to leaving the policy unchanged. We introduce a lightweight post hoc framework that decomposes uncertainty into aleatoric and epistemic components and uses these signals to regulate system responses at inference time. Aleatoric uncertainty is estimated from deviations in the observation distribution using a Mahalanobis density model, while epistemic uncertainty is detected using a noise robust forward dynamics ensemble that isolates model mismatch from measurement corruption. The two signals remain empirically near orthogonal during closed loop execution and enable type specific responses. High aleatoric uncertainty triggers observation recovery, while high epistemic uncertainty moderates control actions. The same signals also regulate adaptive perception by guiding model capacity selection during tracking inference. Experiments demonstrate consistent improvements across both control and perception tasks. In robotic manipulation, the decomposed controller improves task success from 59.4% to 80.4% under compound perturbations and outperforms a combined uncertainty baseline by up to 21.0%. In adaptive tracking inference on MOT17, uncertainty-guided model selection reduces average compute by 58.2% relative to a fixed high capacity detector while preserving detection quality within 0.4%. Code and demo videos are available at https://divake.github.io/uncertainty-decomposition/.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 37 of its 41 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
37 of 41 references.
References · 37
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 913
- 2017Simple Online and Realtime Tracking with a Deep Association Metriccited by 910
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 774
- 2018Learning Dexterous In-Hand Manipulationcited by 687
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 672
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 604
25 more
- 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 596
- 2016MOT16: A Benchmark for Multi-Object Trackingcited by 532
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 508
- 2019Learning agile and dynamic motor skills for legged robotscited by 504
- 2020FairMOT: On the Fairness of Detection and Re-Identification in Multiple Object Trackingcited by 490
- 2021Dynamic Neural Networks: A Surveycited by 408
- 2017Neural Network Dynamics for Model-Based Deep Reinforcement Learning with Model-Free Fine-Tuningcited by 297
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
- 2021DanceTrack: Multi-Object Tracking in Uniform Appearance and Diverse Motioncited by 217
- 2017Adaptive Neural Networks for Efficient Inferencecited by 163
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2022MeMOT: Multi-Object Tracking with Memorycited by 114
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 88
- 2022A Deeper Look into Aleatoric and Epistemic Uncertainty Disentanglementcited by 87
- 2018Safe Reinforcement Learning with Model Uncertainty Estimatescited by 72
- 2025Learning Conformal Abstention Policies for Adaptive Risk Management in Large Language and Vision-Language Modelscited by 21
- 2026TRACER: Trajectory Risk Aggregation for Critical Episodes in Agentic Reasoningcited by 11
- 2025Learnable Conformal Prediction with Context-Aware Nonconformity Functions for Robotic Planning and Perceptioncited by 7
- 2024Navigating the Unknown: Uncertainty-Aware Compute-in-Memory Autonomy of Edge Roboticscited by 6
- 2025Beyond Confidence: Adaptive Abstention in Dual-Threshold Conformal Prediction for Autonomous System Perceptioncited by 6
- 2025Calibrated Decomposition of Aleatoric and Epistemic Uncertainty in Deep Features for Inference-Time Adaptationcited by 6
- 2025INTACT: Inducing Noise Tolerance through Adversarial Curriculum Training for LiDAR-based Safety-Critical Perception and Autonomycited by 5
- 2025Intelligent Sensing-to-Action for Robust Autonomy at the Edge: Opportunities and Challengescited by 5
- 2026Uncertainty-Guided Inference-Time Depth Adaptation for Transformer-Based Visual Trackingcited by 3
- 2020Deep Learning based Uncertainty Decomposition for Real-time Controlcited by 2
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026VLM Judges Can Rank but Cannot Score: Task-Dependent Uncertainty in Multimodal Evaluationcited by 8
- 2026Uncertainty Quantification for Computer-Use Agents: A Benchmark across Vision-Language Models and GUI Grounding Datasetscited by 2
- 2026CURA: Certified Runtime Alarms for Computer-Use Agentscited by 1
- 2026CURA: Certified Runtime Alarms for Computer-Use Agents28 Aug 2026
- 2026Uncertainty Quantification for Computer-Use Agents: A Benchmark across Vision-Language Models and GUI Grounding Datasets24 Jun 2026
- 2026VLM Judges Can Rank but Cannot Score: Task-Dependent Uncertainty in Multimodal Evaluation28 Apr 2026