1+1>2: Can Large Language Models Serve as Cross-Lingual Knowledge Aggregators?
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have garnered significant attention due to their remarkable ability to process information across various languages. Despite their capabilities, they exhibit inconsistencies in handling identical queries in different languages, presenting challenges for further advancement. This paper introduces a method to enhance the multilingual performance of LLMs by aggregating knowledge from diverse languages. This approach incorporates a low-resource knowledge detector specific to a language, a language selection process, and mechanisms for answer replacement and integration. Our experiments demonstrate notable performance improvements, particularly in reducing language performance disparity. An ablation study confirms that each component of our method significantly contributes to these enhancements. This research highlights the inherent potential of LLMs to harmonize multilingual capabilities and offers valuable insights for further exploration.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 29 of its 55 references that are in the map. First posted on arXiv 20 Jun 2024.
Builds on
29 of 55 references.
References · 29
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2024Yi: Open Foundation Models by 01.AIcited by 719
- 2023Baichuan 2: Open Large-scale Language Modelscited by 670
- 2019On the Cross-lingual Transferability of Monolingual Representationscited by 578
- 2020CLUE: A Chinese Language Understanding Evaluation Benchmarkcited by 278
- 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graphcited by 238
- 2023Large Language Model as Attributed Training Data Generator: A Tale of Diversity and Biascited by 232
- 2023MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Usecited by 217
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 206
- 2023What can Large Language Models do in chemistry? A comprehensive benchmark on eight taskscited by 185
17 more
- 2024Don't Hallucinate, Abstain: Identifying LLM Knowledge Gaps via Multi-LLM Collaborationcited by 180
- 2023Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Promptingcited by 165
- 2020MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answeringcited by 153
- 2023DeID-GPT: Zero-shot Medical Text De-Identification by GPT-4cited by 130
- 2023Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languagescited by 97
- 2023Do Multilingual Language Models Think Better in English?cited by 88
- 2024A Survey on Multilingual Large Language Models: Corpora, Alignment, and Biascited by 84
- 2023Mitigating Large Language Model Hallucinations via Autonomous Knowledge Graph-based Retrofittingcited by 70
- 2023BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfercited by 68
- 2023Give Us the Facts: Enhancing Large Language Models with Knowledge Graphs for Fact-aware Language Modelingcited by 56
- 2024Calibrating the Confidence of Large Language Models by Eliciting Fidelitycited by 47
- 2024GUI-World: A Video Benchmark and Dataset for Multimodal GUI-oriented Understandingcited by 43
- 2024Language Ranker: A Metric for Quantifying LLM Performance Across High and Low-Resource Languagescited by 38
- 2016Dataset and Neural Recurrent Sequence Labeling Model for Open-Domain Factoid Question Answeringcited by 35
- 2024Knowledge Graphs as Context Sources for LLM-Based Explanations of Learning Recommendationscited by 31
- 2024X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructionscited by 18
- 2024Machine Translation with Large Language Models: Prompt Engineering for Persian, English, and Russian Directionscited by 12
Built on by
Citing papers per year: 2025: 7; 2026: 2.
9 papers.
- 2025Large Language Models Hallucination: A Comprehensive Surveycited by 49
- 2025MPO: Multilingual Safety Alignment via Reward Gap Optimizationcited by 18
- 2025CALM: Unleashing the Cross-Lingual Self-Aligning Ability of Language Model Question Answeringcited by 10
- 2026ProbeLLM: Automating Principled Diagnosis of LLM Failurescited by 9
- 2025Traveling Across Languages: Benchmarking Cross-Lingual Consistency in Multimodal LLMscited by 3
- 2025Measuring the Effect of Disfluency in Multilingual Knowledge Probing Benchmarkscited by 3
- 2025Semantic Pivots Enable Cross-Lingual Transfer in Large Language Modelscited by 1
- 2026Learning to Route Languages for Multilingual Policy Optimizationcited by 1
- 2025QUST_NLP at SemEval-2025 Task 7: A Three-Stage Retrieval Framework for Monolingual and Crosslingual Fact-Checked Claim Retrievalcited by 0
- 2026Learning to Route Languages for Multilingual Policy Optimization25 May 2026
- 2026ProbeLLM: Automating Principled Diagnosis of LLM Failures13 Feb 2026
- 2025Measuring the Effect of Disfluency in Multilingual Knowledge Probing Benchmarks16 Oct 2025
- 2025Large Language Models Hallucination: A Comprehensive Survey5 Oct 2025
- 2025QUST_NLP at SemEval-2025 Task 7: A Three-Stage Retrieval Framework for Monolingual and Crosslingual Fact-Checked Claim Retrieval12 Jun 2025
- 2025MPO: Multilingual Safety Alignment via Reward Gap Optimization22 May 2025
- 2025Semantic Pivots Enable Cross-Lingual Transfer in Large Language Models22 May 2025
- 2025Traveling Across Languages: Benchmarking Cross-Lingual Consistency in Multimodal LLMs21 May 2025
- 2025CALM: Unleashing the Cross-Lingual Self-Aligning Ability of Language Model Question Answering30 Jan 2025