Bayesian inference for data-efficient, explainable, and safe robotic motion planning: A review
Not on the map. Why?
Abstract (arXiv)
Bayesian inference has many advantages in robotic motion planning over four perspectives: The uncertainty quantification of the policy, safety (risk-aware) and optimum guarantees of robot motions, data-efficiency in training of reinforcement learning, and reducing the sim2real gap when the robot is applied to real-world tasks. However, the application of Bayesian inference in robotic motion planning is lagging behind the comprehensive theory of Bayesian inference. Further, there are no comprehensive reviews to summarize the progress of Bayesian inference to give researchers a systematic understanding in robotic motion planning. This paper first provides the probabilistic theories of Bayesian inference which are the preliminary of Bayesian inference for complex cases. Second, the Bayesian estimation is given to estimate the posterior of policies or unknown functions which are used to compute the policy. Third, the classical model-based Bayesian RL and model-free Bayesian RL algorithms for robotic motion planning are summarized, while these algorithms in complex cases are also analyzed. Fourth, the analysis of Bayesian inference in inverse RL is given to infer the reward functions in a data-efficient manner. Fifth, we systematically present the hybridization of Bayesian inference and RL which is a promising direction to improve the convergence of RL for better motion planning. Sixth, given the Bayesian inference, we present the interpretable and safe robotic motion plannings which are the hot research topic recently. Finally, all algorithms reviewed in this paper are summarized analytically as the knowledge graphs, and the future of Bayesian inference for robotic motion planning is also discussed, to pave the way for data-efficient, explainable, and safe robotic motion planning strategies for practical applications.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 53 of its 132 references that are in the map. First posted on arXiv 16 Jul 2023.
Builds on
53 of 132 references.
References · 53
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,519
- 2016Variational Inference: A Review for Statisticianscited by 1,466
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
- 2020A Survey of Deep Active Learningcited by 547
- 2018Mean Field Multi-Agent Reinforcement Learningcited by 202
- 2021Monte Carlo Tree Search: A Review of Recent Modifications and Applicationscited by 158
- 2016Bayesian Optimization with Safety Constraints: Safe and Automatic Parameter Tuning in Roboticscited by 134
- 2021Uncertainty Weighted Actor-Critic for Offline Reinforcement Learningcited by 125
- 2020Shared Experience Actor-Critic for Multi-Agent Reinforcement Learningcited by 114
- 2020Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learningcited by 99
38 more
- 2021Scaling Multi-Agent Reinforcement Learning with Selective Parameter Sharingcited by 85
- 2019Uncertainty Quantification with Statistical Guarantees in End-to-End Autonomous Driving Controlcited by 60
- 2022Constrained Policy Optimization via Bayesian World Modelscited by 55
- 2013Parallel Gaussian Process Optimization with Upper Confidence Bound and Pure Explorationcited by 50
- 2018Meta-Learning Priors for Efficient Online Bayesian Regressioncited by 47
- 2020Data-efficient Domain Randomization with Bayesian Optimizationcited by 43
- 2021Risk-Averse Bayes-Adaptive Reinforcement Learningcited by 28
- 2019AC-Teach: A Bayesian Actor-Critic Method for Policy Learning with an Ensemble of Suboptimal Teacherscited by 27
- 2021GoSafe: Globally Optimal Safe Robot Learningcited by 27
- 2020Task-Agnostic Online Reinforcement Learning with an Infinite Mixture of Gaussian Processescited by 23
- 2020Lifelong Incremental Reinforcement Learning with Online Bayesian Inferencecited by 23
- 2020PlaNet of the Bayesians: Reconsidering and Improving Deep Planning Network by Incorporating Bayesian Inferencecited by 22
- 2021Curiosity-Driven Exploration via Latent Bayesian Surprisecited by 22
- 2021Learning Human Objectives from Sequences of Physical Correctionscited by 21
- 2021Safety Assurances for Human-Robot Interaction via Confidence-aware Game-theoretic Human Modelscited by 21
- 2019Cooperation-Aware Reinforcement Learning for Merging in Dense Trafficcited by 20
- 2019Spiking Neural Network on Neuromorphic Hardware for Energy-Efficient Unidimensional SLAMcited by 19
- 2019Bayesian Optimization for Iterative Learningcited by 19
- 2019Bayesian Learning-Based Adaptive Control for Safety Critical Systemscited by 19
- 2021Bayesian Controller Fusion: Leveraging Control Priors in Deep Reinforcement Learning for Roboticscited by 18
- 2023On the Convergence of Coordinate Ascent Variational Inferencecited by 18
- 2017Deep Predictive Models for Collision Risk Assessment in Autonomous Drivingcited by 15
- 2014Scalable Planning and Learning for Multiagent POMDPs: Extended Versioncited by 14
- 2020Modeling and Predicting Trust Dynamics in Human-Robot Teaming: A Bayesian Inference Approachcited by 14
- 2018Probabilistic Model Checking of Robots Deployed in Extreme Environmentscited by 12
- 2020Cautious Bayesian Optimization for Efficient and Scalable Policy Searchcited by 12
- 2021Infinite Time Horizon Safety of Bayesian Neural Networkscited by 12
- 2020L1-GP: L1 Adaptive Control with Bayesian Learningcited by 11
- 2018Goal Inference Improves Objective and Perceived Performance in Human-Robot Collaborationcited by 10
- 2020I Know What You Meant: Learning Human Objectives by (Under)estimating Their Choice Setcited by 9
- 2020A User's Guide to Calibrating Robotics Simulatorscited by 9
- 2014Batch Nonlinear Continuous-Time Trajectory Estimation as Exactly Sparse Gaussian Process Regressioncited by 8
- 2020Computing the racing line using Bayesian optimizationcited by 8
- 2019Bayesian Curiosity for Efficient Exploration in Reinforcement Learningcited by 7
- 2020Bayesian Safe Learning and Control with Sum-of-Squares Analysis and Polynomial Kernelscited by 7
- 2021Risk Averse Bayesian Reward Learning for Autonomous Navigation from Human Demonstrationcited by 4
- 2019Fully Bayesian Recurrent Neural Networks for Safe Reinforcement Learningcited by 3
- 2021A Bayesian Approach to Reinforcement Learning of Vision-Based Vehicular Controlcited by 3
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2023: 1.
1 paper.