Beyond Cross-Lingual Transfer: Benchmarking Propagation Boundaries in Multilingual LLM Unlearning
On the map: LLM safety and security → Machine unlearning
Abstract (arXiv)
Large Language Model (LLM) unlearning aims to suppress target knowledge while preserving general capabilities. In multilingual settings, unlearning must additionally propagate within its intended linguistic scope. However, existing evaluations mainly measure cross-lingual transfer and cannot distinguish insufficient from excessive propagation. We introduce CLLPU (Cross-Lingual and Language-Bound Protocol for LLM Unlearning), a multilingual benchmark that formulates this problem through two settings: common-goal forgetting, where target knowledge should be suppressed across all languages, and language-conditioned forgetting, where suppression should remain confined to a designated language. CLLPU combines goal-guided topic pairing, schema-aware relation matching, and dual-anchor multilingual translation to construct 800 matched knowledge-unit pairs and 72,000 QA instances across ten languages. Experiments with six representative methods on Llama-3.1-8B-Instruct reveal opposite failure modes: forgetting remains incomplete when universal suppression is required, yet spreads beyond the intended boundary when language-conditioned confinement is required. We further find that general multilingual utility can conceal damage to neighbor knowledge. These findings establish propagation control as a central challenge for multilingual LLM unlearning. We publicly release CLLPU together with its construction pipeline.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Machine unlearning, one of 12 directions in LLM safety and security. Builds on 20 of its 35 references that are in the map. First posted on arXiv 5 Sep 2026.
Builds on
20 of 35 references.
Closest ancestors · 13
Same direction, newest first
- 2026Multilingual Unlearning in LLMs: Transfer, Dynamics, and Reversibility2 Jun
- 2026Knowledge Beyond Language: Bridging the Gap in Multilingual Machine Unlearning Evaluation14 May
- 2026ICU-Bench:Benchmarking Continual Unlearning in Multimodal Large Language Models7 May
- 2026BalDRO: A Distributionally Robust Optimization based Framework for Large Language Model Unlearning14 Jan
- 2026Multilingual Amnesia: On the Transferability of Unlearning in Multilingual LLMs9 Jan
- 2026Maximizing Local Entropy Where It Matters: Prefix-Aware Localized LLM Unlearning6 Jan
- 2025OpenUnlearning: Accelerating LLM Unlearning via Unified Benchmarking of Methods and Metrics14 Jun
- 2025Which Retain Set Matters for LLM Unlearning? A Case Study on Entity Unlearning17 Feb
- 2024Benchmarking Vision Language Model Unlearning via Fictitious Facial Identity Dataset5 Nov
- 2024Learn and Unlearn: Addressing Misinformation in Multilingual LLMs19 Jun
- 2024Cross-Lingual Unlearning of Selective Knowledge in Multilingual Language Models18 Jun
- 2024Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning8 Apr
1 more
Other references · 7
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,050
- 2019Machine Unlearningcited by 1,020
- 2024The WMDP Benchmark: Measuring and Reducing Malicious Use With Unlearningcited by 488
- 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
- 2024Min-K%++: Improved Baseline for Detecting Pre-Training Data from Large Language Modelscited by 102
- 2025The Emergence of Abstract Thought in Large Language Models Beyond Any Languagecited by 20
Built on by
Citing papers per year: 2026: 1.
1 paper.