NatLan: Native Language Prompting Facilitates Knowledge Elicitation Through Language Trigger Provision and Domain Trigger Retention
Not on the map. Why?
Abstract (arXiv)
Multilingual large language models (MLLMs) do not perform as well when answering questions in non-dominant languages as they do in their dominant languages. Although existing translate-then-answer methods alleviate this issue, the mechanisms behind their effectiveness remain unclear. In this study, we analogize the dominant language of MLLMs to the native language of humans and use two human cognitive features: the Language Trigger (LT) and the Domain Trigger (DT), to interpret the mechanisms behind translate-then-answer methods. This reveals that while sufficient LTs are provided by these methods, there remains a deficiency in DT retention. To mitigate this issue, we propose Native Language Prompting (NatLan), employing a Multi-MLLM collaboration strategy and introducing an additional role-enhanced domain-specific MLLM with stronger multilingual understanding capabilities as the translator. Across five language QA benchmarks, NatLan achieves up to a 31.28% improvement in accuracy and, compared to existing state-of-the-art methods, provides comparable or greater retention of DTs in up to 87% of cases. Our code is available at https://github.com/AnonyNLP/NatLan.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 29 references that are in the map. First posted on arXiv 7 Aug 2024.
Builds on
15 of 29 references.
References · 15
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 708
- 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 530
- 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 333
- 2023Self-collaboration Code Generation via ChatGPTcited by 258
- 2023Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Promptingcited by 165
- 2022Prompting PaLM for Translation: Assessing Strategies and Performancecited by 145
- 2023Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMscited by 104
3 more
- 2023Do Multilingual Language Models Think Better in English?cited by 88
- 2016Neural Machine Translation with Reconstructioncited by 28
- 2023TeCS: A Dataset and Benchmark for Tense Consistency of Machine Translationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Cross-lingual QA: A Key to Unlocking In-context Cross-lingual Performance
- 2025When Language Shapes Thought: Cross-Lingual Transfer of Factual Knowledge in Question Answering
- 2025EMCEE: Improving Multilingual Capability of LLMs via Bridging Knowledge and Reasoning with Extracted Synthetic Multilingual Context
- 2024The Power of Question Translation Training in Multilingual Reasoning: Broadened Scope and Deepened Insights
- 2023Metacognitive Prompting Improves Understanding in Large Language Models
- 2025Cross-Lingual Prompt Steerability: Towards Accurate and Robust LLM Behavior across Languages
- 2026From Script to Semantics: Prompting Strategies for African NLI
- 2026MSQA: A Natively Sourced Multilingual and Multicultural SimpleQA Benchmark