CAP: Controllable Alignment Prompting for Unlearning in LLMs
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Large language models (LLMs) trained on unfiltered corpora inherently risk retaining sensitive information, necessitating selective knowledge unlearning for regulatory compliance and ethical safety. However, existing parameter-modifying methods face fundamental limitations: high computational costs, uncontrollable forgetting boundaries, and strict dependency on model weight access. These constraints render them impractical for closed-source models, yet current non-invasive alternatives remain unsystematic and reliant on empirical experience. To address these challenges, we propose the Controllable Alignment Prompting for Unlearning (CAP) framework, an end-to-end prompt-driven unlearning paradigm. CAP decouples unlearning into a learnable prompt optimization process via reinforcement learning, where a prompt generator collaborates with the LLM to suppress target knowledge while preserving general capabilities selectively. This approach enables reversible knowledge restoration through prompt revocation. Extensive experiments demonstrate that CAP achieves precise, controllable unlearning without updating model parameters, establishing a dynamic alignment mechanism that overcomes the transferability limitations of prior methods.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 28 of its 48 references that are in the map. First posted on arXiv 23 Apr 2026.
Builds on
28 of 48 references.
Closest ancestors · 14
Same direction, newest first
- 2026ALTER: Asymmetric LoRA for Token-Entropy-Guided Unlearning of LLMs2 Mar
- 2025DRAGON: Guard LLM Unlearning in Context via Negative Detection and Reasoning8 Nov
- 2024Revisiting Who's Harry Potter: Towards Targeted Unlearning from a Causal Intervention Perspective24 Jul
- 2024Soft Prompting for Unlearning in Large Language Models17 Jun
- 2024Large Language Model Unlearning via Embedding-Corrupted Prompts12 Jun
- 2024What makes unlearning hard and what to do about it3 Jun
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
- 2024Guardrail Baselines for Unlearning in LLMs5 Mar
- 2024Deciphering the Impact of Pretraining Data on Large Language Models through Machine Unlearning18 Feb
- 2024Towards Safer Large Language Models through Machine Unlearning15 Feb
- 2024TOFU: A Task of Fictitious Unlearning for LLMs11 Jan
- 2023In-Context Unlearning: Language Models as Few Shot Unlearners11 Oct
2 more
Other references · 14
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,045
- 2023Zephyr: Direct Distillation of LM Alignmentcited by 506
- 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 95
- 2025STAIR: Improving Safety Alignment with Introspective Reasoningcited by 77
- 2022Iteratively Prompt Pre-trained Language Models for Chain of Thoughtcited by 75
- 2024PRewrite: Prompt Rewriting with Reinforcement Learningcited by 45
- 2026Language-Guided Token Compression with Reinforcement Learning in Large Vision-Language Modelscited by 10
- 2024ChainLM: Empowering Large Language Models with Improved Chain-of-Thought Promptingcited by 8
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Leak-Resistant Unlearning: A New Benchmark for Evaluating Multi-Hop Reasoning Consistency and Recovery Robustnesscited by 0
- 2026Unlearning Is Not Just Erasing: Temporal Decoupling via Generation Inequalitycited by 0
- 2026Cascade: Hierarchical Recoverability Control for Large Language Model Unlearningcited by 0
- 2026Cascade: Hierarchical Recoverability Control for Large Language Model Unlearning15 Sep 2026
- 2026Unlearning Is Not Just Erasing: Temporal Decoupling via Generation Inequality24 Aug 2026
- 2026Leak-Resistant Unlearning: A New Benchmark for Evaluating Multi-Hop Reasoning Consistency and Recovery Robustness5 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026CALIBURN: Self-Calibrated LLM Unlearning Alignment
- 2025Scalable and Robust LLM Unlearning by Correcting Responses with Retrieved Exclusions
- 2026Unlearning in LLMs: Methods, Evaluation, and Open Challenges
- 2023Large Language Model Unlearning
- 2025RULE: Reinforcement UnLEarning Achieves Forget-Retain Pareto Optimality
- 2025Leveraging Machine Unlearning for Cost-Efficient Preference Alignment
- 2024Rethinking Machine Unlearning for Large Language Models
- 2026Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs