mlsanityData to 7 Oct 2026

BMIKE-53: Investigating Cross-Lingual Knowledge Editing with In-Context Learning

arXiv 2406.17764 ↗First posted 25 Jun 2024cs.CL cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

This paper introduces BMIKE-53, a comprehensive benchmark for cross-lingual in-context knowledge editing (IKE) across 53 languages, unifying three knowledge editing (KE) datasets: zsRE, CounterFact, and WikiFactDiff. Cross-lingual KE, which requires knowledge edited in one language to generalize across others while preserving unrelated knowledge, remains underexplored. To address this gap, we systematically evaluate IKE under zero-shot, one-shot, and few-shot setups, incorporating tailored metric-specific demonstrations. Our findings reveal that model scale and demonstration alignment critically govern cross-lingual IKE efficacy, with larger models and tailored demonstrations significantly improving performance. Linguistic properties, particularly script type, strongly influence performance variation across languages, with non-Latin languages underperforming due to issues like language confusion. Code and data are publicly available at: https://github.com/ercong21/MultiKnow/.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 23 of its 36 references that are in the map. First posted on arXiv 25 Jun 2024.

Builds on

23 of 36 references.

References · 23

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2022Locating and Editing Factual Associations in GPTcited by 2,609
  4. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  5. 2022Mass-Editing Memory in a Transformercited by 976
  6. 2021Editing Factual Knowledge in Language Modelscited by 548
  7. 2022Memory-Based Model Editing at Scalecited by 443
  8. 2017Zero-Shot Relation Extraction via Reading Comprehensioncited by 425
  9. 2023Editing Large Language Models: Problems, Methods, and Opportunitiescited by 367
  10. 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 292
  11. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 290
  12. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
11 more
  1. 2023Evaluating the Ripple Effects of Knowledge Editing in Language Modelscited by 238
  2. 2022Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matterscited by 221
  3. 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
  4. 2021Multilingual LAMA: Investigating Knowledge in Multilingual Pretrained Language Modelscited by 132
  5. 2023Cross-Lingual Consistency of Factual Knowledge in Multilingual Language Modelscited by 117
  6. 2021Knowledgeable or Educated Guess? Revisiting Language Models as Knowledge Basescited by 107
  7. 2022Language Anisotropic Cross-Lingual Model Editingcited by 26
  8. 2024Cross-lingual Editing in Multilingual Language Modelscited by 18
  9. 2024The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional Analysiscited by 13
  10. 2024WikiFactDiff: A Large, Realistic, and Temporally Adaptable Dataset for Atomic Factual Knowledge Update in Causal Language Modelscited by 9
  11. 2024ToPro: Token-Level Prompt Decomposition for Cross-Lingual Sequence Labeling Taskscited by 7

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 10.

13 papers.

Sort:

By area:

  1. 2025Lost in Multilinguality: Dissecting Cross-lingual Factual Inconsistency in Transformer Language Modelscited by 43
  2. 2024Vox Populi, Vox AI? Using Language Models to Estimate German Public Opinioncited by 13
  3. 2025XCOMPS: A Multilingual Benchmark of Conceptual Minimal Pairscited by 9
  4. 2025Bring Your Own Knowledge: A Survey of Methods for LLM Knowledge Expansioncited by 8
  5. 2025Mechanistic Understanding and Mitigation of Language Confusion in English-Centric Large Language Modelscited by 8
  6. 2024Better Call SAUL: Fluent and Consistent Language Model Editing with Generation Regularizationcited by 4
  7. 2025LLM in the Loop: Creating the ParaDeHate Dataset for Hate Speech Detoxificationcited by 4
  8. 2024CKnowEdit: A New Chinese Knowledge Editing Dataset for Linguistics, Facts, and Logic Error Correction in LLMscited by 3
  9. 2025Measuring the Effect of Disfluency in Multilingual Knowledge Probing Benchmarkscited by 3
  10. 2025Editing Across Languages: A Survey of Multilingual Knowledge Editingcited by 2
  11. 2025LiveCLKTBench: Towards Reliable Evaluation of Cross-Lingual Knowledge Transfer in Multilingual LLMscited by 2
  12. 2025ADS-Edit: A Multimodal Knowledge Editing Dataset for Autonomous Driving Systemscited by 0
1 more
  1. 2025An Exploration of Knowledge Editing for Arabiccited by 0