mlsanityData to 7 Oct 2026

Rapid Optimization for Jailbreaking LLMs via Subconscious Exploitation and Echopraxia

arXiv 2402.05467 ↗First posted 8 Feb 2024cs.AI cs.CL cs.CRcited by 12

On the map: LLM safety and security → Jailbreaking

Abstract (arXiv)

Large Language Models (LLMs) have become prevalent across diverse sectors, transforming human life with their extraordinary reasoning and comprehension abilities. As they find increased use in sensitive tasks, safety concerns have gained widespread attention. Extensive efforts have been dedicated to aligning LLMs with human moral principles to ensure their safe deployment. Despite their potential, recent research indicates aligned LLMs are prone to specialized jailbreaking prompts that bypass safety measures to elicit violent and harmful content. The intrinsic discrete nature and substantial scale of contemporary LLMs pose significant challenges in automatically generating diverse, efficient, and potent jailbreaking prompts, representing a continuous obstacle. In this paper, we introduce RIPPLE (Rapid Optimization via Subconscious Exploitation and Echopraxia), a novel optimization-based method inspired by two psychological concepts: subconsciousness and echopraxia, which describe the processes of the mind that occur without conscious awareness and the involuntary mimicry of actions, respectively. Evaluations across 6 open-source LLMs and 4 commercial LLM APIs show RIPPLE achieves an average Attack Success Rate of 91.5%, outperforming five current methods by up to 47.0% with an 8x reduction in overhead. Furthermore, it displays significant transferability and stealth, successfully evading established detection mechanisms. The code of our work is available at urlhttps://github.com/SolidShen/RIPPLEofficial/tree/official

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Jailbreaking, one of 12 directions in LLM safety and security. Builds on 38 of its 54 references that are in the map. First posted on arXiv 8 Feb 2024.

Builds on

38 of 54 references.

Closest ancestors · 10

Same direction, newest first

  1. 2024How Johnny Can Persuade LLMs to Jailbreak Them: Rethinking Persuasion to Challenge AI Safety by Humanizing LLMs12 Jan
  2. 2023DeepInception: Hypnotize Large Language Model to Be Jailbreaker6 Nov
  3. 2023Jailbreaking Black Box Large Language Models in Twenty Queries12 Oct
  4. 2023Catastrophic Jailbreak of Open-source LLMs via Exploiting Generation10 Oct
  5. 2023Low-Resource Languages Jailbreak GPT-43 Oct
  6. 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Prompts19 Sep
  7. 2023Defending Against Alignment-Breaking Attacks via Robustly Aligned LLM18 Sep
  8. 2023GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher12 Aug
  9. 2023Universal and Transferable Adversarial Attacks on Aligned Language Models27 Jul
  10. 2023Jailbroken: How Does LLM Safety Training Fail?5 Jul

Other references · 28

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  8. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  9. 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
  10. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  11. 2020Extracting Training Data from Large Language Modelscited by 2,144
  12. 2023Code Llama: Open Foundation Models for Codecited by 2,105
16 more
  1. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  2. 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,106
  3. 2023The Falcon Series of Open Language Modelscited by 526
  4. 2023Hard Prompts Made Easy: Gradient-Based Discrete Optimization for Prompt Tuning and Discoverycited by 329
  5. 2023Are aligned neural networks adversarially aligned?cited by 305
  6. 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 253
  7. 2021Gradient-based Adversarial Attacks against Text Transformerscited by 233
  8. 2023Automatically Auditing Large Language Models via Discrete Optimizationcited by 187
  9. 2016Towards better decoding and language model integration in sequence to sequence modelscited by 100
  10. 2022Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLPcited by 99
  11. 2023Contrastive Decoding Improves Reasoning in Large Language Modelscited by 71
  12. 2017Towards Crafting Text Adversarial Samplescited by 55
  13. 2022Constrained Optimization with Dynamic Bound-scaling for Effective NLPBackdoor Defensecited by 44
  14. 2021Your fairness may vary: Pretrained language model fairness in toxic text classificationcited by 38
  15. 2023Make Them Spill the Beans! Coercive Knowledge Extraction from (Production) LLMscited by 26
  16. 2023On the Safety of Open-Sourced Large Language Models: Does Alignment Really Prevent Them From Being Misused?cited by 25

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 5; 2026: 1.

12 papers.