FreoStream:Enhancing Stream Guardrails via Future-Aware Reasoning and Safety-Aligned Optimization
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Stream guardrails enable token-level safety detection before full responses are generated. However, they often make overly conservative judgements and block those sensitive but safe tokens, which is known as over-refusal. Due to lack of full context, they also fail to detect implicitly harmful content from jailbreaking. To address these challenges, we propose FreoStream, a novel streaming guardrail framework. Specifically, FreoStream fine-tunes a LoRA module to perform Future-Aware Reasoning when the base guardrail detects unsafe tokens. The reasoning process follows a Future-Reason-Judge paradigm: predict the future, reason about the full context and give the final judgement. This design can effectively reduce over-refusal by incorporating the future information. Moreover, we introduce the Safety-Aligned Optimization module that extracts the safety-aligned component from the reasoning gradients to update the base guardrail model, thereby enhancing streaming safety detection. Extensive experiments on various safety benchmarks demonstrate that FreoStream achieves lower over-refusal rates and better jailbreak defense compared to existing streaming guardrails.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 16 of its 37 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
16 of 37 references.
Closest ancestors · 4
Same direction, newest first
- 2026TrajGuard: Streaming Hidden-state Trajectory Detection for Decoding-time Jailbreak Defense9 Apr
- 2025Reasoned Safety Alignment: Ensuring Jailbreak Defense via Answer-Then-Check15 Sep
- 2023DeepInception: Hypnotize Large Language Model to Be Jailbreaker6 Nov
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
Other references · 12
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024GPT-4o System Cardcited by 4,588
- 2023A Survey of Large Language Modelscited by 2,576
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2025OpenAI GPT-5 System Cardcited by 989
- 2025Qwen3Guard Technical Reportcited by 155
- 2025GuardReasoner: Towards Reasoning-based LLM Safeguardscited by 100
- 2025FalseReject: A Resource for Improving Contextual Safety and Mitigating Over-Refusals in LLMs via Structured Reasoningcited by 58
- 2025From Judgment to Interference: Early Stopping LLM Harmful Outputs via Streaming Content Monitoringcited by 22
- 2026YuFeng-XGuard: A Reasoning-Centric, Interpretable, and Flexible Guardrail Model for Large Language Modelscited by 19
- 2026Predict, Don't React: Value-Based Safety Forecasting for LLM Streamingcited by 3
- 2025Understanding and Mitigating Over-refusal for Large Language Models via Representation Interventioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025AdaptiveGuard: Towards Adaptive Runtime Safety for LLM-Powered Software
- 2025Jailbreak Distillation: Renewable Safety Benchmarking
- 2026SafeDream: Safety World Model for Proactive Early Jailbreak Detection
- 2025Active Honeypot Guardrail System: Probing and Confirming Multi-Turn LLM Jailbreaks
- 2025SoK: Evaluating Jailbreak Guardrails for Large Language Models
- 2026STAR-S: Improving Safety Alignment through Self-Taught Reasoning on Safety Rules
- 2025Reasoning-to-Defend: Safety-Aware Reasoning Can Defend Large Language Models from Jailbreaking
- 2025When Models Outthink Their Safety: Unveiling and Mitigating Self-Jailbreak in Large Reasoning Models