mlsanityData to 7 Oct 2026

Edit Once, Update Everywhere: A Simple Framework for Cross-Lingual Knowledge Synchronization in LLMs

arXiv 2502.14645 ↗First posted 20 Feb 2025cs.CL cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Knowledge editing allows for efficient adaptation of large language models (LLMs) to new information or corrections without requiring full retraining. However, prior methods typically focus on either single-language editing or basic multilingual editing, failing to achieve true cross-linguistic knowledge synchronization. To address this, we present a simple and practical state-of-the-art (SOTA) recipe Cross-Lingual Knowledge Democracy Edit (X-KDE), designed to propagate knowledge from a dominant language to other languages effectively. Our X-KDE comprises two stages: (i) Cross-lingual Edition Instruction Tuning (XE-IT), which fine-tunes the model on a curated parallel dataset to modify in-scope knowledge while preserving unrelated information, and (ii) Target-language Preference Optimization (TL-PO), which applies advanced optimization techniques to ensure consistency across languages, fostering the transfer of updates. Additionally, we contribute a high-quality, cross-lingual dataset, specifically designed to enhance knowledge transfer across languages. Extensive experiments on the Bi-ZsRE and MzsRE benchmarks show that X-KDE significantly enhances cross-lingual performance, achieving an average improvement of +8.19%, while maintaining high accuracy in monolingual settings.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 47 of its 54 references that are in the map. First posted on arXiv 20 Feb 2025.

Builds on

47 of 54 references.

References · 47

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  7. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  8. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
  9. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  10. 2020Learning to summarize from human feedbackcited by 2,562
  11. 2020Extracting Training Data from Large Language Modelscited by 2,144
  12. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
35 more
  1. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
  2. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,308
  3. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
  4. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
  5. 2022Mass-Editing Memory in a Transformercited by 976
  6. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 951
  7. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
  8. 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
  9. 2021Knowledge Neurons in Pretrained Transformerscited by 590
  10. 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 556
  11. 2021Editing Factual Knowledge in Language Modelscited by 548
  12. 2021Fast Model Editing at Scalecited by 491
  13. 2020Artificial Intelligence, Values and Alignmentcited by 443
  14. 2022Memory-Based Model Editing at Scalecited by 443
  15. 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
  16. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  17. 2023How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resourcescited by 405
  18. 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 390
  19. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  20. 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 292
  21. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
  22. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
  23. 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 238
  24. 2023Transformer-Patcher: One Mistake worth One Neuroncited by 196
  25. 2023Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERTcited by 155
  26. 2020Editable Neural Networkscited by 154
  27. 2023Towards Making the Most of ChatGPT for Machine Translationcited by 138
  28. 2024The Butterfly Effect of Model Editing: Few Edits Can Trigger Large Language Models Collapsecited by 54
  29. 2024Learning to Edit: Aligning LLMs with Knowledge Editingcited by 43
  30. 2024Can Knowledge Editing Really Correct Hallucinations?cited by 28
  31. 2022Language Anisotropic Cross-Lingual Model Editingcited by 26
  32. 2024Multilingual Knowledge Editing with Language-Agnostic Factual Neuronscited by 18
  33. 2023Towards Unifying Multi-Lingual and Cross-Lingual Summarizationcited by 15
  34. 2024MPN: Leveraging Multilingual Patch Neuron for Cross-lingual Model Editingcited by 9
  35. 2024MEMLA: Enhancing Multilingual Knowledge Editing with Neuron-Masked Low-Rank Adaptationcited by 6

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Retrieval-augmented Multilingual Knowledge Editing
  2. 2025Aligning Language Models with Real-time Knowledge Editing
  3. 2024Knowledge Editing through Chain-of-Thought
  4. 2024Multilingual Pretraining and Instruction Tuning Improve Cross-Lingual Knowledge Alignment, But Only Shallowly
  5. 2024CrossIn: An Efficient Instruction Tuning Approach for Cross-Lingual Knowledge Alignment
  6. 2025Benchmarking and Rethinking Knowledge Editing for Large Language Models
  7. 2025Rethinking Cross-lingual Alignment: Balancing Transfer and Cultural Erasure in Multilingual LLMs
  8. 2024MLaKE: Multilingual Knowledge Editing Benchmark for Large Language Models