Variational Neural Belief Parameterizations for Robust Dexterous Grasping under Multimodal Uncertainty
Not on the map. Why?
Abstract (arXiv)
Contact variability, sensing uncertainty, and external disturbances make grasp execution stochastic. Expected-quality objectives ignore tail outcomes and often select grasps that fail under adverse contact realizations. Risk-sensitive POMDPs address this failure mode, but many use particle-filter beliefs that scale poorly, obstruct gradient-based optimization, and estimate Conditional Value-at-Risk (CVaR) with high-variance approximations. We instead formulate grasp acquisition as variational inference over latent contact parameters and object pose, representing the belief with a differentiable Gaussian mixture. We use Gumbel-Softmax component selection and location-scale reparameterization to express samples as smooth functions of the belief parameters, enabling pathwise gradients through a differentiable CVaR surrogate for direct optimization of tail robustness. In simulation, our variational neural belief improves robust grasp success under contact-parameter uncertainty and exogenous force perturbations while reducing planning time by roughly an order of magnitude relative to particle-filter model-predictive control. On a serial-chain robot arm with a multifingered hand, we validate grasp-and-lift success under object-pose uncertainty against a Gaussian baseline. Both methods succeed on the tested perturbations, but our controller terminates in fewer steps and less wall-clock time while achieving a higher tactile grasp-quality proxy. Our learned belief also calibrates risk more accurately, keeping mean absolute calibration error below 0.14 across tested simulation regimes, compared with 0.58 for a Cross-Entropy Method planner. We provide code, simulation assets, and a dataset of 243 force-closed grasps at the following link: www.github.com/coenwerem/vnb-grasp.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 17 of its 50 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
17 of 50 references.
References · 17
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,726
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,225
- 2016Variational Inference: A Review for Statisticianscited by 1,469
- 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 754
- 2017Distributional Reinforcement Learning with Quantile Regressioncited by 465
- 2017Dex-Net 2.0: Deep Learning to Plan Robust Grasps with Synthetic Point Clouds and Analytic Grasp Metricscited by 260
- 2016Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Datacited by 154
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 132
- 2017Global Convergence of Langevin Dynamics Based Algorithms for Nonconvex Optimizationcited by 97
- 2020Sample-efficient Cross-Entropy Method for Real-time Planningcited by 94
- 2021Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures using Differentiable Force Closure Estimatorcited by 70
- 2022Deep Learning Approaches to Grasp Synthesis: A Reviewcited by 70
5 more
- 2016Learning and Policy Search in Stochastic Dynamical Systems with Bayesian Neural Networkscited by 49
- 2022NeuralGrasps: Learning Implicit Representations for Grasps of Multiple Robotic Handscited by 12
- 2025Safety-Aware Reinforcement Learning for Control via Risk-Sensitive Action-Value Iteration and Quantile Regressioncited by 2
- 2021Particle MPC for Uncertain and Learning-Based Controlcited by 1
- 2024Toward An Analytic Theory of Intrinsic Robustness for Dexterous Graspingcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.