Edit Once, Update Everywhere: A Simple Framework for Cross-Lingual Knowledge Synchronization in LLMs
Not on the map. Why?
Abstract (arXiv)
Knowledge editing allows for efficient adaptation of large language models (LLMs) to new information or corrections without requiring full retraining. However, prior methods typically focus on either single-language editing or basic multilingual editing, failing to achieve true cross-linguistic knowledge synchronization. To address this, we present a simple and practical state-of-the-art (SOTA) recipe Cross-Lingual Knowledge Democracy Edit (X-KDE), designed to propagate knowledge from a dominant language to other languages effectively. Our X-KDE comprises two stages: (i) Cross-lingual Edition Instruction Tuning (XE-IT), which fine-tunes the model on a curated parallel dataset to modify in-scope knowledge while preserving unrelated information, and (ii) Target-language Preference Optimization (TL-PO), which applies advanced optimization techniques to ensure consistency across languages, fostering the transfer of updates. Additionally, we contribute a high-quality, cross-lingual dataset, specifically designed to enhance knowledge transfer across languages. Extensive experiments on the Bi-ZsRE and MzsRE benchmarks show that X-KDE significantly enhances cross-lingual performance, achieving an average improvement of +8.19%, while maintaining high accuracy in monolingual settings.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 47 of its 54 references that are in the map. First posted on arXiv 20 Feb 2025.
Builds on
47 of 54 references.
References · 47
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
- 2022Locating and Editing Factual Associations in GPTcited by 2,609
- 2020Learning to summarize from human feedbackcited by 2,562
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
35 more
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
- 2022Mass-Editing Memory in a Transformercited by 976
- 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 951
- 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
- 2021Knowledge Neurons in Pretrained Transformerscited by 590
- 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 556
- 2021Editing Factual Knowledge in Language Modelscited by 548
- 2021Fast Model Editing at Scalecited by 491
- 2020Artificial Intelligence, Values and Alignmentcited by 443
- 2022Memory-Based Model Editing at Scalecited by 443
- 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
- 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
- 2023How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resourcescited by 405
- 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 390
- 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
- 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 292
- 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
- 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
- 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 238
- 2023Transformer-Patcher: One Mistake worth One Neuroncited by 196
- 2023Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERTcited by 155
- 2020Editable Neural Networkscited by 154
- 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
- 2024The Butterfly Effect of Model Editing: Few Edits Can Trigger Large Language Models Collapsecited by 54
- 2024Learning to Edit: Aligning LLMs with Knowledge Editingcited by 43
- 2024Can Knowledge Editing Really Correct Hallucinations?cited by 28
- 2022Language Anisotropic Cross-Lingual Model Editingcited by 26
- 2024Multilingual Knowledge Editing with Language-Agnostic Factual Neuronscited by 18
- 2023Towards Unifying Multi-Lingual and Cross-Lingual Summarizationcited by 15
- 2024MPN: Leveraging Multilingual Patch Neuron for Cross-lingual Model Editingcited by 9
- 2024MEMLA: Enhancing Multilingual Knowledge Editing with Neuron-Masked Low-Rank Adaptationcited by 6
Built on by
Citing papers per year: 2025: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2023Retrieval-augmented Multilingual Knowledge Editing
- 2025Aligning Language Models with Real-time Knowledge Editing
- 2024Knowledge Editing through Chain-of-Thought
- 2024Multilingual Pretraining and Instruction Tuning Improve Cross-Lingual Knowledge Alignment, But Only Shallowly
- 2024CrossIn: An Efficient Instruction Tuning Approach for Cross-Lingual Knowledge Alignment
- 2025Benchmarking and Rethinking Knowledge Editing for Large Language Models
- 2025Rethinking Cross-lingual Alignment: Balancing Transfer and Cultural Erasure in Multilingual LLMs
- 2024MLaKE: Multilingual Knowledge Editing Benchmark for Large Language Models