mlsanityData to 7 Oct 2026

Retrieval-augmented Multilingual Knowledge Editing

arXiv 2312.13040 ↗First posted 20 Dec 2023cs.CLcited by 13

On the map: Retrieval-augmented generation → Generation and context integration

Abstract (arXiv)

Knowledge represented in Large Language Models (LLMs) is quite often incorrect and can also become obsolete over time. Updating knowledge via fine-tuning is computationally resource-hungry and not reliable, and so knowledge editing (KE) has developed as an effective and economical alternative to inject new knowledge or to fix factual errors in LLMs. Although there has been considerable interest in this area, current KE research exclusively focuses on the monolingual setting, typically in English. However, what happens if the new knowledge is supplied in one language, but we would like to query the LLM in a different language? To address the problem of multilingual knowledge editing, we propose Retrieval-augmented Multilingual Knowledge Editor (ReMaKE) to update new knowledge in LLMs. ReMaKE can perform model-agnostic knowledge editing in multilingual settings. ReMaKE concatenates the new knowledge retrieved from a multilingual knowledge base with prompts. Our experimental results show that ReMaKE outperforms baseline knowledge editing methods by a significant margin and is the first KE method to work in a multilingual setting. We provide our multilingual knowledge editing dataset (MzsRE) in 12 languages, which along with code, and additional project information is available at https://github.com/Vicky-Wil/ReMaKE.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 18 of its 29 references that are in the map. First posted on arXiv 20 Dec 2023.

Builds on

18 of 29 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023REPLUG: Retrieval-Augmented Black-Box Language Models30 Jan

Other references · 17

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  4. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  5. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  6. 2022Mass-Editing Memory in a Transformercited by 976
  7. 2021Editing Factual Knowledge in Language Modelscited by 548
  8. 2022Memory-Based Model Editing at Scalecited by 443
  9. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  10. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  11. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
  12. 2022Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptorscited by 267
5 more
  1. 2023Inspecting and Editing Knowledge Representations in Language Modelscited by 140
  2. 2022Calibrating Factual Knowledge in Pretrained Language Modelscited by 92
  3. 2023Journey to the Center of the Knowledge Neurons: Discoveries of Language-Independent Knowledge Neurons and Degenerate Knowledge Neuronscited by 56
  4. 2023Assessing the Reliability of Large Language Model Knowledgecited by 13
  5. 2022Semantic-Oriented Unlabeled Priming for Large-Scale Language Modelscited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 4; 2026: 2.

13 papers.

Sort:

By area:

  1. 2024Detoxifying Large Language Models via Knowledge Editingcited by 86
  2. 2024Semantics-Adaptive Activation Intervention for LLMs via Dynamic Steering Vectorscited by 61
  3. 2024Sharing Matters: Analysing Neurons Across Languages and Tasks in LLMscited by 33
  4. 2025The Bitter Lesson Learned from 2,000+ Multilingual Benchmarkscited by 31
  5. 2024Everything is Editable: Extend Knowledge Editing to Unstructured Data in Large Language Modelscited by 18
  6. 2025CPA-RAG:Covert Poisoning Attacks on Retrieval-Augmented Generation in Large Language Modelscited by 17
  7. 2024Lifelong Knowledge Editing for Vision Language Models with Low-Rank Mixture-of-Expertscited by 14
  8. 2024MLaKE: Multilingual Knowledge Editing Benchmark for Large Language Modelscited by 11
  9. 2024STACKFEED: Structured Textual Actor-Critic Knowledge Base Editing with FeedBackcited by 4
  10. 2025NeuralDB: Scaling Knowledge Editing in LLMs to 100,000 Facts with Neural KV Databasecited by 2
  11. 2025Scalable and Robust LLM Unlearning by Correcting Responses with Retrieved Exclusionscited by 2
  12. 2026On the Robustness of Knowledge Editing for Detoxificationcited by 0
1 more
  1. 2026Merging Methods for Multilingual Knowledge Editing for Large Language Models: An Empirical Odysseycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024MEMLA: Enhancing Multilingual Knowledge Editing with Neuron-Masked Low-Rank Adaptation
  2. 2025Edit Once, Update Everywhere: A Simple Framework for Cross-Lingual Knowledge Synchronization in LLMs
  3. 2023Knowledge Editing for Large Language Models: A Survey
  4. 2025Knowledge Updating? No More Model Editing! Just Selective Contextual Reasoning
  5. 2025Benchmarking and Rethinking Knowledge Editing for Large Language Models
  6. 2024Knowledge Editing through Chain-of-Thought
  7. 2024Learning to Edit: Aligning LLMs with Knowledge Editing
  8. 2022Adapters for Enhanced Modeling of Multilingual Knowledge and Text