Active Honeypot Guardrail System: Probing and Confirming Multi-Turn LLM Jailbreaks
On the map: LLM safety and security → Jailbreaking
Abstract (arXiv)
Large language models (LLMs) are increasingly vulnerable to multi-turn jailbreak attacks, where adversaries iteratively elicit harmful behaviors that bypass single-turn safety filters. Existing defenses predominantly rely on passive rejection, which either fails against adaptive attackers or overly restricts benign users. We propose a honeypot-based proactive guardrail system that transforms risk avoidance into risk utilization. Our framework fine-tunes a bait model to generate ambiguous, non-actionable but semantically relevant responses, which serve as lures to probe user intent. Combined with the protected LLM's safe reply, the system inserts proactive bait questions that gradually expose malicious intent through multi-turn interactions. We further introduce the Honeypot Utility Score (HUS), measuring both the attractiveness and feasibility of bait responses, and use a Defense Efficacy Rate (DER) for balancing safety and usability. Initial experiment on MHJ Datasets with recent attack method across GPT-4o show that our system significantly disrupts jailbreak success while preserving benign user experience.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 12 of its 15 references that are in the map. First posted on arXiv 16 Oct 2025.
Builds on
12 of 15 references.
Closest ancestors · 8
Same direction, newest first
- 2024MRJ-Agent: An Effective Jailbreak Agent for Multi-Round Dialogue6 Nov
- 2024JAILJUDGE: A Comprehensive Jailbreak Judge Benchmark with Multi-Agent Enhanced Explanation Evaluation Framework11 Oct
- 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yet27 Aug
- 2024Multi-Turn Context Jailbreak Attack on Large Language Models From First Principles8 Aug
- 2024JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attacks3 Apr
- 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attack2 Apr
- 2024AutoDefense: Multi-Agent LLM Defense against Jailbreak Attacks2 Mar
- 2024Semantic Mirror Jailbreak: Genetic Algorithm Based Jailbreak Prompts Against Open-source LLMs21 Feb
Other references · 4
- 2023Multi-step Jailbreaking Privacy Attacks on ChatGPTcited by 320
- 2023Jailbreak in pieces: Compositional Adversarial Attacks on Multi-Modal Language Modelscited by 260
- 2025Jailbreaking Multimodal Large Language Models via Shuffle Inconsistencycited by 42
- 2024Jailbreak Attacks and Defenses against Multimodal Generative Models: A Surveycited by 31
Built on by
Citing papers per year: 2026: 2.
2 papers.