mlsanityData to 14 Oct 2026

BreakFun: Jailbreaking LLMs via Object Instantiation under Simulated Code Execution

arXiv 2510.17904 ↗First posted 19 Oct 2025cs.CR cs.AI cs.CLcited by 0

On the map: LLM safety and security → Jailbreaking

Abstract (arXiv)

Large Language Models (LLMs) are widely used because they process structures, syntax and code well, but this same ability also makes them paradoxically vulnerable. We introduce BreakFun, a jailbreak method that frames a harmful request as code-execution simulation. The prompt gives the model a benign Python class definition, the "Trojan Schema", and asks what that code would print if it ran. To answer, the model must create an object from the class and invent a value for each field, and the adversarial field names steer those values toward the attacker's goal. The harmful content therefore appears as a side-effect of the simulated instantiation, not as a direct answer. A three-part prompt carries the attack: an innocent frame, the Trojan Schema, and a Chain-of-Thought distraction. On JailbreakBench, BreakFun reaches an average attack success rate of 89% across 13 open-weight and commercial models (open-weight ~98%, API systems ~78%), and 100% on several. An ablation identifies the Trojan Schema as the strongest contributing component. As a counter-ablation probe we introduce Adversarial Prompt Deconstruction (APD), in which a second LLM writes out all readable text in the prompt before it judges safety. APD improves detection across three model families, and a probe-specific ablation shows that the transcription step gives most of the gain. Our findings show that LLM safety must account for content that a simulation task produces as a side-effect, not only for content that a user requests directly.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 14 of its 30 references that are in the map. First posted on arXiv 19 Oct 2025.

Builds on

14 of 30 references.

Closest ancestors · 12

Same direction, newest first

  1. 2025Sugar-Coated Poison: Benign Generation Unlocks LLM Jailbreaking8 Apr
  2. 2025The TIP of the Iceberg: Revealing a Hidden Class of Task-in-Prompt Adversarial Attacks on LLMs27 Jan
  3. 2024h4rm3l: A language for Composable Jailbreak Attack Synthesis9 Aug
  4. 2024Great, Now Write an Article About That: The Crescendo Multi-Turn LLM Jailbreak Attack2 Apr
  5. 2024DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers25 Feb
  6. 2024Play Guessing Game with LLM: Indirect Jailbreak Attack with Implicit Clues14 Feb
  7. 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs12 Jan
  8. 2023A Wolf in Sheep's Clothing: Generalized Nested Jailbreak Prompts can Fool Large Language Models Easily14 Nov
  9. 2023DeepInception: Hypnotize Large Language Model to Be Jailbreaker6 Nov
  10. 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
  11. 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts19 Sep
  12. 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher12 Aug

Other references · 2

  1. 2024PsySafe: A Comprehensive Framework for Psychological-based Attack, Defense, and Evaluation of Multi-agent System Safetycited by 80
  2. 2024CodeAttack: Revealing Safety Generalization Challenges of Large Language Models via Code Completioncited by 76

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Casting a SPELL: Sentence Pairing Exploration for LLM Limitation-breaking
  2. 2025The Trojan Example: Jailbreaking LLMs through Template Filling and Unsafety Reasoning
  3. 2024A Comprehensive Study of Jailbreak Attack versus Defense for Large Language Models
  4. 2025JULI: Jailbreak Large Language Models by Self-Introspection
  5. 2024EnJa: Ensemble Jailbreak on Large Language Models
  6. 2024SequentialBreak: Large Language Models Can be Fooled by Embedding Jailbreak Prompts into Sequential Prompt Chains
  7. 2023Analyzing the Inherent Response Tendency of LLMs: Real-World Instructions-Driven Jailbreak
  8. 2025LLMs Caught in the Crossfire: Malware Requests and Jailbreak Challenges