mlsanityData to 7 Oct 2026

ABNet: Attention BarrierNet for Safe and Scalable Robot Learning

arXiv 2406.13025 ↗First posted 18 Jun 2024cs.LG cs.RO cs.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Safe learning is central to AI-enabled robots where a single failure may lead to catastrophic results. Barrier-based method is one of the dominant approaches for safe robot learning. However, this method is not scalable, hard to train, and tends to generate unstable signals under noisy inputs that are challenging to be deployed for robots. To address these challenges, we propose a novel Attention BarrierNet (ABNet) that is scalable to build larger foundational safe models in an incremental manner. Each head of BarrierNet in the ABNet could learn safe robot control policies from different features and focus on specific part of the observation. In this way, we do not need to one-shotly construct a large model for complex tasks, which significantly facilitates the training of the model while ensuring its stable output. Most importantly, we can still formally prove the safety guarantees of the ABNet. We demonstrate the strength of ABNet in 2D robot obstacle avoidance, safe robot manipulation, and vision-based end-to-end autonomous driving, with results showing much better robustness and guarantees over existing models.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 41 references that are in the map. First posted on arXiv 18 Jun 2024.

Builds on

29 of 41 references.

References · 29

  1. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  2. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  3. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  4. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  5. 2018Neural Ordinary Differential Equationscited by 3,733
  6. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  7. 2021Convex optimizationcited by 2,479
  8. 2015End-to-End Training of Deep Visuomotor Policiescited by 847
  9. 2021Scaling Vision with Sparse Mixture of Expertscited by 740
  10. 2022Mixture-of-Experts with Expert Choice Routingcited by 611
  11. 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 598
  12. 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
17 more
  1. 2023LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Compositioncited by 359
  2. 2016Control Barrier Function Based Quadratic Programs for Safety Critical Systemscited by 261
  3. 2018Differentiable MPC for End-to-end Planning and Controlcited by 178
  4. 2019A General Framework for Uncertainty Estimation in Deep Learningcited by 119
  5. 2022Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalizationcited by 97
  6. 2020Learning Control Barrier Functions from Expert Demonstrationscited by 88
  7. 2017Uncertainty-Aware Reinforcement Learning for Collision Avoidancecited by 86
  8. 2021VISTA 2.0: An Open, Data-driven Simulator for Multimodal Sensing and Policy Learning for Autonomous Vehiclescited by 81
  9. 2023Drive Anywhere: Generalizable End-to-end Autonomous Driving with Multi-modal Foundation Modelscited by 59
  10. 2024PoCo: Policy Composition from and for Heterogeneous Robot Learningcited by 42
  11. 2020Synthesis of Control Barrier Functions Using a Supervised Machine Learning Approachcited by 35
  12. 2020Safe Optimal Control Using Stochastic Barrier Functions and Deep Forward-Backward SDEscited by 22
  13. 2020ShieldNN: A Provably Safe NN Filter for Unsafe NN Controllerscited by 17
  14. 2020Learning Safe Neural Network Controllers with Barrier Certificatescited by 16
  15. 2022On the Forward Invariance of Neural ODEscited by 10
  16. 2023Learning Robust and Correct Controllers from Signal Temporal Logic Specifications Using BarrierNetcited by 6
  17. 2023Learning Stability Attention in Vision-based End-to-end Driving Policiescited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Safe Learning for Contact-Rich Robot Tasks: A Survey from Classical Learning-Based Methods to Safe Foundation Models
  2. 2026Safe Vision Language Action Models via Barrier Enhanced Flow Matching
  3. 2023ConBaT: Control Barrier Transformer for Safe Policy Learning
  4. 2026Your Model Already Knows: Attention-Guided Safety Filter for Vision-Language-Action Models
  5. 2025Towards Safe Robot Foundation Models Using Inductive Biases
  6. 2026CrossSafe: Towards Cross-Embodiment Latent Safety Filters
  7. 2026Neuro-Symbolic Safety Guidance for Vision-Language-Action Models via Constrained Flow Matching
  8. 2025Safety Certification in the Latent space using Control Barrier Functions and World Models