mlsanityData to 7 Oct 2026

Robotics-Inspired Guardrails for Foundation Models in Socially Sensitive Domains

arXiv 2605.19940 ↗First posted 19 May 2026cs.AI cs.ROcited by 0

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

Foundation models are increasingly deployed in socially sensitive domains such as education, mental health, and caregiving, where failures are often cumulative and context-dependent. Existing guardrail approaches -- ranging from training-time alignment to prompting, decoding constraints, and post-hoc moderation -- primarily provide empirical risk reduction rather than enforceable behavioral guarantees, and largely treat safety as a property of individual outputs rather than interaction trajectories. We reframe guardrails as a problem of runtime behavioral control over interaction trajectories, drawing on robotics to introduce formal constructs for constraint enforcement in uncertain, closed-loop systems. We instantiate these ideas in the Grounded Observer framework and apply it across three real-world deployments: small talk, in-home autism therapy, and behavioral de-escalation in schools. Across settings, the framework enables runtime interventions that mitigate drift into undesirable interaction regimes while adapting to diverse social contexts. We discuss extensions to the framework and propose research directions toward stronger guarantees.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 32 of its 76 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

32 of 76 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal6 Feb

Other references · 31

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  3. 2017Deep reinforcement learning from human preferencescited by 3,846
  4. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  5. 2018YOLOv3: An Incremental Improvementcited by 2,652
  6. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  7. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
  8. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  9. 2024JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Modelscited by 494
  10. 2020Artificial Intelligence, Values and Alignmentcited by 443
  11. 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 434
  12. 2017Safe Reinforcement Learning via Shieldingcited by 427
19 more
  1. 2019Control Barrier Functions: Theory and Applicationscited by 332
  2. 2024Reinforcement learningcited by 236
  3. 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 217
  4. 2024Jailbreak Attacks and Defenses Against Large Language Models: A Surveycited by 215
  5. 2018Fast Lexically Constrained Decoding with Dynamic Beam Allocation for Neural Machine Translationcited by 181
  6. 2024Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templatescited by 94
  7. 2018A predictive safety filter for learning-based control of constrained nonlinear dynamical systemscited by 91
  8. 2022Conversing with Copilot: Exploring Prompt Engineering for Solving CS1 Problems Using Natural Languagecited by 81
  9. 2024Lynx: An Open Source Hallucination Evaluation Modelcited by 55
  10. 2025VeriGuard: Enhancing LLM Agent Safety via Verified Code Generationcited by 46
  11. 2018SOTER: A Runtime Assurance Framework for Programming Safe Robotics Systemscited by 24
  12. 2017"Dave...I can assure you...that it's going to be all right..." -- A definition, case for, and survey of algorithmic assurances in human-autonomy trust relationshipscited by 22
  13. 2023Adversarial Attacks on Foundational Vision Modelscited by 13
  14. 2021Action Priors for Large Action Spaces in Roboticscited by 10
  15. 2020Assured Autonomy: Path Toward Living With Autonomous Systems We Can Trustcited by 7
  16. 2026Beyond Compromise: Pareto-Lenient Consensus for Efficient Multi-Preference LLM Alignmentcited by 2
  17. 2020Safety Controller Synthesis for Collaborative Robotscited by 1
  18. 2024More than Chit-Chat: Developing Robots for Small-Talk Interactionscited by 1
  19. 2025A Robot-Assisted Approach to Small Talk Training for Adults with ASDcited by 1

Built on by

Not cited yet.