HiveTraceGuard-Pro: A Compact Generative Guardrail for Prompt Injection, Jailbreaks, and Adversarial Obfuscation
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
Production LLMs must handle inputs that attempt to override system instructions, bypass safety policies or elicit harmful responses. A common mitigation is a separate guardrail model. Existing reports, however, provide little evidence on Russian prompt injection or Russian surface obfuscation. We present HiveTraceGuard-Pro, a 0.6B generative guardrail LoRA-tuned from Qwen3-0.6B. It is trained on Russian and English and uses one binary scoring rule (safe/unsafe) for the final target turn. Its training corpus pairs harmful examples, where a counterpart exists, with benign examples from the same domain and applies eight obfuscation transforms to both labels. In one harness, we compare HiveTraceGuard-Pro with thirty-four other guards on nineteen benchmark groups, sixteen of which are public. Its aggregate key is 0.7432, behind 0.7641 and 0.7552 for the two higher-scoring guards. Over the sixteen public groups alone, its key is 0.7153 and four of the thirty-four other suite guards score higher. In a fifteen-model comparison, HiveTraceGuard-Pro has the highest clean Russian robustness combined-F1 (0.88) and Russian prompt-injection recall (0.999). Both results use Russian sets assembled by our team, and at least 27.1% of the prompt-injection set overlaps the training corpus. Its 14.3 ms median latency is the lowest among those fifteen models in that run. Across the suite, FPR is 0.268 and FNR is 0.156. All reported response results use a legacy standalone-reply serialization rather than the natural assistant-role path of the shipped chat template. We release the merged weights on Hugging Face under Apache-2.0. The corpus, evaluation sets and evaluation code remain internal.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 21 of its 23 references that are in the map. First posted on arXiv 1 Sep 2026.
Builds on
21 of 23 references.
Closest ancestors · 2
Same direction, newest first
- 2024Code-Switching Red-Teaming: LLM Evaluation for Safety and Multilingual Understanding17 Jun
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal6 Feb
Other references · 19
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 860
- 2023XSTest: A Test Suite for Identifying Exaggerated Safety Behaviours in Large Language Modelscited by 505
- 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
- 2022A Holistic Approach to Undesired Content Detection in the Real Worldcited by 356
- 2024OR-Bench: An Over-Refusal Benchmark for Large Language Modelscited by 244
- 2024ShieldGemma: Generative AI Content Moderation Based on Gemmacited by 243
- 2023Multilingual Jailbreak Challenges in Large Language Modelscited by 240
- 2023ToxicChat: Unveiling Hidden Challenges of Toxicity Detection in Real-World User-AI Conversationcited by 231
- 2025Qwen3Guard Technical Reportcited by 155
- 2025Aegis2.0: A Diverse AI Safety Dataset and Risks Taxonomy for Alignment of LLM Guardrailscited by 132
- 2023SimpleSafetyTests: a Test Suite for Identifying Critical Safety Risks in Large Language Modelscited by 76
7 more
- 2024The Multilingual Alignment Prism: Aligning Global and Local Preferences to Reduce Harmcited by 70
- 2025PolyGuard: A Multilingual Safety Moderation Tool for 17 Languagescited by 59
- 2023All Languages Matter: On the Multilingual Safety of Large Language Modelscited by 53
- 2024S-Eval: Towards Automated and Comprehensive Safety Evaluation for Large Language Modelscited by 33
- 2026YuFeng-XGuard: A Reasoning-Centric, Interpretable, and Flexible Guardrail Model for Large Language Modelscited by 19
- 2026SingGuard: A Policy-Adaptive Multimodal LLM Guardrail with Dynamic Reasoningcited by 6
- 2025OpenGuardrails: A Configurable, Unified, and Scalable Guardrails Platform for Large Language Modelscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Adversarial Prompt Evaluation: Systematic Benchmarking of Guardrails Against Prompt Input Attacks on LLMs
- 2025CAPTURE: Context-Aware Prompt Injection Testing and Robustness Enhancement
- 2026Decoding Guardrails: XAI-Guided Perturbation Analysis of Prompt Injection Detection
- 2025DRIP: Defending Prompt Injection via Token-wise Representation Editing and Residual Instruction Fusion
- 2026Prompt Overflow: What the Guardrail Inspects Is Not What the Model Infers
- 2025Bypassing LLM Guardrails: An Empirical Analysis of Evasion Attacks against Prompt Injection and Jailbreak Detection Systems
- 2026SRD-GUARD: A Defense Framework of LLMs via Semantic Rewriting and Joint Multi-Model Scoring for Latent Intent Exposure
- 2025AprielGuard