mlsanityData to 7 Oct 2026

Multi-FAct: Assessing Factuality of Multilingual LLMs using FActScore

arXiv 2402.18045 ↗First posted 28 Feb 2024cs.CLcited by 18

Not on the map. Why?

Abstract (arXiv)

Evaluating the factuality of long-form large language model (LLM)-generated text is an important challenge. Recently there has been a surge of interest in factuality evaluation for English, but little is known about the factuality evaluation of multilingual LLMs, specially when it comes to long-form generation. %This paper systematically evaluates multilingual LLMs' factual accuracy across languages and geographic regions. We introduce a simple pipeline for multilingual factuality evaluation, by applying FActScore (Min et al., 2023) for diverse languages. In addition to evaluating multilingual factual generation, we evaluate the factual accuracy of long-form text generation in topics that reflect regional diversity. We also examine the feasibility of running the FActScore pipeline using non-English Wikipedia and provide comprehensive guidelines on multilingual factual evaluation for regionally diverse topics.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 23 of its 30 references that are in the map. First posted on arXiv 28 Feb 2024.

Builds on

23 of 30 references.

References · 23

  1. 2023Mistral 7Bcited by 3,065
  2. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  3. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
  4. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  5. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  6. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  7. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  8. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  9. 2020KILT: a Benchmark for Knowledge Intensive Language Taskscited by 571
  10. 2021A Survey on Automated Fact-Checkingcited by 376
  11. 2023MEGA: Multilingual Evaluation of Generative AIcited by 291
  12. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 247
11 more
  1. 2022Challenges and Strategies in Cross-Cultural NLPcited by 216
  2. 2023Having Beer after Prayer? Measuring Cultural Bias in Large Language Modelscited by 153
  3. 2024Fine-grained Hallucination Detection and Editing for Language Modelscited by 146
  4. 2021X-FACT: A New Benchmark Dataset for Multilingual Fact Checkingcited by 90
  5. 2019Reasoning Over Semantic-Level Graph for Fact Checkingcited by 69
  6. 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 52
  7. 2022mFACE: Multilingual Summarization with Factual Consistency Evaluationcited by 42
  8. 2022Nonparametric Masked Language Modelingcited by 39
  9. 2024Comparing Hallucination Detection Metrics for Multilingual Generationcited by 18
  10. 2023Multilingual large language models leak human stereotypes across language boundariescited by 12
  11. 2024Global-Liar: Factuality of LLMs over Time and Geographic Regionscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 14; 2026: 2.

18 papers.

Sort:

By area:

  1. 2025Do Multilingual LLMs Think In English?cited by 75
  2. 2024CaLMQA: Exploring culturally specific long-form question answering across 23 languagescited by 31
  3. 2025Charting the Landscape of African NLP: Mapping Progress and Shaping the Road Aheadcited by 15
  4. 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
  5. 2024Multi-OphthaLingua: A Multilingual Benchmark for Assessing and Debiasing LLM Ophthalmological QA in LMICscited by 10
  6. 2025Culture is Everywhere: A Call for Intentionally Cultural Evaluationcited by 10
  7. 2025Beyond Translation: LLM-Based Data Generation for Multilingual Fact-Checkingcited by 8
  8. 2025Bhaasha, Bhasa, Zaban: A Survey for Low-Resourced Languages in South Asia -- Current Stage and Challengescited by 6
  9. 2025How Much Do LLMs Hallucinate across Languages? On Realistic Multilingual Estimation of LLM Hallucinationcited by 5
  10. 2025The World According to LLMs: How Geographic Origin Influences LLMs' Entity Deduction Capabilitiescited by 5
  11. 2025BenchHub: A Unified Benchmark Suite for Holistic and Customizable LLM Evaluationcited by 3
  12. 2025Beyond speculation: Measuring the growing presence of LLM-generated texts in multilingual disinformationcited by 1
6 more
  1. 2025Better To Ask in English? Evaluating Factual Accuracy of Multilingual LLMs in English and Low-Resource Languagescited by 1
  2. 2025ARISE: An Adaptive Resolution-Aware Metric for Test-Time Scaling Evaluation in Large Reasoning Modelscited by 1
  3. 2025Embedding Trust: Semantic Isotropy Predicts Nonfactuality in Long-Form Text Generationcited by 1
  4. 2026Inference-Time Steering for Cross-Lingual Factual Consistency in LLMscited by 1
  5. 2025Understanding Inequality of LLM Fact-Checking over Geographic Regions with Agent and Retrieval modelscited by 0
  6. 2026The Chronicles of RiDiC: Generating Datasets with Controlled Popularity Distribution for Long-form Factuality Evaluationcited by 0