Lattice: Generative Guardrails for Conversational Agents
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
Conversational AI systems require guardrails to prevent harmful outputs, yet existing approaches use static rules that cannot adapt to new threats or deployment contexts. We introduce Lattice, a framework for self-constructing and continuously improving guardrails. Lattice operates in two stages: construction builds initial guardrails from labeled examples through iterative simulation and optimization; continuous improvement autonomously adapts deployed guardrails through risk assessment, adversarial testing, and consolidation. Evaluated on the ProsocialDialog dataset, Lattice achieves 91% F1 on held-out data, outperforming keyword baselines by 43pp, LlamaGuard by 25pp, and NeMo by 4pp. The continuous improvement stage achieves 7pp F1 improvement on cross-domain data through closed-loop optimization. Our framework shows that effective guardrails can be self-constructed through iterative optimization.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 8 of its 17 references that are in the map. First posted on arXiv 24 Jan 2026.
Builds on
8 of 17 references.
Closest ancestors · 3
Same direction, newest first
- 2025Virus: Harmful Fine-tuning Attack for Large Language Models Bypassing Guardrail Moderation29 Jan
- 2024CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreference25 Jun
- 2024Fine-Tuning, Quantization, and LLMs: Navigating Unintended Outcomes5 Apr
Other references · 5
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
- 2024Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithmscited by 139
- 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
- 2024Improving Reward Models with Synthetic Critiquescited by 44
- 2024HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactionscited by 42
Built on by
Citing papers per year: 2026: 1.
1 paper.