mlsanityData to 13 Oct 2026

AERIC: Anticipatory Hidden-State Monitoring for Implicit Harmful Dialogue

arXiv 2605.23974 ↗First posted 13 May 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Current language models create two safety challenges: risk must be detected early enough to avoid exposing harmful continuation, and the harmfulness itself may be implicit rather than signaled by overtly toxic text. Existing response-level guards are strong at judging completed text, and native streaming guards move closer to token time, but both settings leave open whether a lightweight monitor can anticipate implicit harmful drift from the generator's own internal trajectory. We study anticipatory same-pass monitoring, where a safety monitor may read hidden states produced during ordinary decoding but may not invoke an additional forward pass through the base model. We introduce AERIC, a transfer-oriented hidden-state approach for implicit harmful dialogue that combines short-horizon hazard forecasting, support-sensitive suppression, and prompt-conditioned residual scoring under a same-pass exponential moving average decision rule. The default linear monitor contains only 387 trainable head parameters. Against Qwen3GuardStream-4B on balanced benchmarks, AERIC improves AUROC from 0.6830 to 0.7143 on DiaSafety and from 0.8219 to 0.8582 on Harmful Advice. For promptlevel trigger benchmarks, we calibrate the AERIC threshold by a source-side safe-budget rule that maximizes trigger coverage while constraining the safe-trigger rate to at most 10%. Under that rule, trigger@64 reaches 0.6438 and 0.4656 on HarmBench DirectRequest and 0.6849 and 0.7363 on SocialHarmBench for Qwen and Gemma, respectively, withholding between 23.53 and 41.86 answer tokens on average. Same-pass deployment is also efficient: on a 63-prompt harmfulprompt fixed-generation benchmark aggregated over HarmBench DirectRequest and SocialHarmBench under Qwen3-8B, the monitor increases mean latency by only 2.34%, whereas Qwen3Guard-Stream-4B increases it by 79.40%.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 25 of its 28 references that are in the map. First posted on arXiv 13 May 2026.

Builds on

25 of 28 references.

References · 25

  1. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,405
  2. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 723
  3. 2023The Internal State of an LLM Knows When It's Lyingcited by 652
  4. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 482
  5. 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 421
  6. 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 238
  7. 2024OR-Bench: An Over-Refusal Benchmark for Large Language Modelscited by 235
  8. 2025Qwen3Guard Technical Reportcited by 147
  9. 2023Future Lens: Anticipating Subsequent Tokens from a Single Hidden Statecited by 119
  10. 2021On the Safety of Conversational Models: Taxonomy, Dataset, and Benchmarkcited by 73
  11. 2025FalseReject: A Resource for Improving Contextual Safety and Mitigating Over-Refusals in LLMs via Structured Reasoningcited by 56
  12. 2023Unveiling the Implicit Toxicity in Large Language Modelscited by 51
13 more
  1. 2022Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Modelscited by 49
  2. 2025From Judgment to Interference: Early Stopping LLM Harmful Outputs via Streaming Content Monitoringcited by 21
  3. 2024HiddenGuard: Fine-Grained Safe Generation with Specialized Representation Routercited by 16
  4. 2022Mitigating Covertly Unsafe Text within Natural Language Systemscited by 13
  5. 2023A Benchmark for Understanding Dialogue Safety in Mental Health Supportcited by 13
  6. 2025Think Twice, Generate Once: Safeguarding by Progressive Self-Reflectioncited by 11
  7. 2026LLM Safety From Within: Detecting Harmful Content with Internal Representationscited by 11
  8. 2025Kelp: A Streaming Safeguard for Large Models via Latent Dynamics-Guided Risk Detectioncited by 7
  9. 2025People readily follow personal advice from AI but it does not improve their well-beingcited by 6
  10. 2025SocialHarmBench: Revealing LLM Vulnerabilities to Socially Harmful Requestscited by 5
  11. 2026NExT-Guard: Training-Free Streaming Safeguard without Token-Level Labelscited by 3
  12. 2026Predict, Don't React: Value-Based Safety Forecasting for LLM Streamingcited by 3
  13. 2025Prefix Probing: Lightweight Harmful Content Detection for Large Language Modelscited by 1

Built on by

Not cited yet.