Introspective Robot Perception using Smoothed Predictions from Bayesian Neural Networks
Not on the map. Why?
Abstract (arXiv)
This work focuses on improving uncertainty estimation in the field of object classification from RGB images and demonstrates its benefits in two robotic applications. We employ a (BNN), and evaluate two practical inference techniques to obtain better uncertainty estimates, namely Concrete Dropout (CDP) and Kronecker-factored Laplace Approximation (LAP). We show a performance increase using more reliable uncertainty estimates as unary potentials within a Conditional Random Field (CRF), which is able to incorporate contextual information as well. Furthermore, the obtained uncertainties are exploited to achieve domain adaptation in a semi-supervised manner, which requires less manual efforts in annotating data. We evaluate our approach on two public benchmark datasets that are relevant for robot perception tasks.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 25 of its 43 references that are in the map. First posted on arXiv 27 Sep 2021.
Builds on
25 of 43 references.
References · 25
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
- 2016Adversarial Machine Learning at Scalecited by 934
- 2017Deep Bayesian Active Learning with Image Datacited by 812
- 2015Optimizing Neural Networks with Kronecker-factored Approximate Curvaturecited by 776
- 2016Deep Exploration via Bootstrapped DQNcited by 518
- 2019Revisiting Self-Supervised Visual Representation Learningcited by 250
- 2017Concrete Dropoutcited by 227
13 more
- 2017T-LESS: An RGB-D Dataset for 6D Pose Estimation of Texture-less Objectscited by 210
- 2017Cost-Effective Active Learning for Deep Image Classificationcited by 165
- 2017Multiplicative Normalizing Flows for Variational Bayesian Neural Networkscited by 157
- 2014Joint Training of a Convolutional Network and a Graphical Model for Human Pose Estimationcited by 129
- 2016Composing graphical models with neural networks for structured representations and fast inferencecited by 113
- 2014Deep Convolutional Neural Fields for Depth Estimation from a Single Imagecited by 106
- 2016Structured and Efficient Variational Deep Learning with Matrix Gaussian Posteriorscited by 82
- 2019Self-supervised Domain Adaptation for Computer Vision Taskscited by 58
- 2015Bayesian Dark Knowledgecited by 45
- 2018Adversarial Distillation of Bayesian Neural Network Posteriorscited by 27
- 2017Active Self-Paced Learning for Cost-Effective and Progressive Face Identificationcited by 19
- 2015CRF Learning with CNN Features for Image Segmentationcited by 6
- 2016A Survey on Bayesian Deep Learningcited by 2
Built on by
Citing papers per year: 2023: 3; 2024: 2.
5 papers.
- 2024Evaluating Uncertainty-based Failure Detection for Closed-Loop LLM Plannerscited by 15
- 2023Topology-Matching Normalizing Flows for Out-of-Distribution Detection in Robot Learningcited by 7
- 2024FFHFlow: Diverse and Uncertainty-Aware Dexterous Grasp Generation via Flow Variational Inferencecited by 3
- 2023Efficient and Feasible Robotic Assembly Sequence Planning via Graph Representation Learningcited by 2
- 2023Density-based Feasibility Learning with Normalizing Flows for Introspective Robotic Assemblycited by 2
- 2024FFHFlow: Diverse and Uncertainty-Aware Dexterous Grasp Generation via Flow Variational Inference21 Jul 2024
- 2024Evaluating Uncertainty-based Failure Detection for Closed-Loop LLM Planners1 Jun 2024
- 2023Topology-Matching Normalizing Flows for Out-of-Distribution Detection in Robot Learning11 Nov 2023
- 2023Density-based Feasibility Learning with Normalizing Flows for Introspective Robotic Assembly3 Jul 2023
- 2023Efficient and Feasible Robotic Assembly Sequence Planning via Graph Representation Learning17 Mar 2023