mlsanityData to 7 Oct 2026

Lattice: Generative Guardrails for Conversational Agents

arXiv 2601.17481 ↗First posted 24 Jan 2026cs.AIcited by 1

On the map: LLM safety and security → Safety alignment, refusal and guardrails

Abstract (arXiv)

Conversational AI systems require guardrails to prevent harmful outputs, yet existing approaches use static rules that cannot adapt to new threats or deployment contexts. We introduce Lattice, a framework for self-constructing and continuously improving guardrails. Lattice operates in two stages: construction builds initial guardrails from labeled examples through iterative simulation and optimization; continuous improvement autonomously adapts deployed guardrails through risk assessment, adversarial testing, and consolidation. Evaluated on the ProsocialDialog dataset, Lattice achieves 91% F1 on held-out data, outperforming keyword baselines by 43pp, LlamaGuard by 25pp, and NeMo by 4pp. The continuous improvement stage achieves 7pp F1 improvement on cross-domain data through closed-loop optimization. Our framework shows that effective guardrails can be self-constructed through iterative optimization.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 8 of its 17 references that are in the map. First posted on arXiv 24 Jan 2026.

Builds on

8 of 17 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Virus: Harmful Fine-tuning Attack for Large Language Models Bypassing Guardrail Moderation29 Jan
  2. 2024CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreference25 Jun
  3. 2024Fine-Tuning, Quantization, and LLMs: Navigating Unintended Outcomes5 Apr

Other references · 5

  1. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 347
  2. 2024Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithmscited by 139
  3. 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
  4. 2024Improving Reward Models with Synthetic Critiquescited by 44
  5. 2024HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactionscited by 42

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.