Evaluation Methodology for Large Language Models for Multilingual Document Question and Answer
Not on the map. Why?
Abstract (arXiv)
With the widespread adoption of Large Language Models (LLMs), in this paper we investigate the multilingual capability of these models. Our preliminary results show that, translating the native language context, question and answer into a high resource language produced the best results.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 1 Feb 2024.
Builds on
16 of 26 references.
References · 16
- 2017Attention Is All You Needcited by 59,932
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2020XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalizationcited by 738
- 2019On the Cross-lingual Transferability of Monolingual Representationscited by 575
- 2022Language Models are Multilingual Chain-of-Thought Reasonerscited by 518
- 2020How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Modelscited by 313
- 2020Multilingual Translation with Extensible Multilingual Pretraining and Finetuningcited by 287
- 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 156
- 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processingcited by 126
- 2019Multilingual is not enough: BERT for Finnishcited by 118
- 2021How to Adapt Your Pretrained Multilingual Model to 1600 Languagescited by 54
4 more
- 2023ChatGPT: Applications, Opportunities, and Threatscited by 28
- 2021Predicting the Performance of Multilingual NLP Modelscited by 24
- 2021ParaShoot: A Hebrew Question Answering Datasetcited by 12
- 2023How Vocabulary Sharing Facilitates Multilingualism in LLaMA?cited by 12
Built on by
Not cited yet.