mlsanityData to 7 Oct 2026

AILS-NTUA at SemEval-2025 Task 3: Leveraging Large Language Models and Translation Strategies for Multilingual Hallucination Detection

arXiv 2503.02442 ↗First posted 4 Mar 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Multilingual hallucination detection stands as an underexplored challenge, which the Mu-SHROOM shared task seeks to address. In this work, we propose an efficient, training-free LLM prompting strategy that enhances detection by translating multilingual text spans into English. Our approach achieves competitive rankings across multiple languages, securing two first positions in low-resource languages. The consistency of our results highlights the effectiveness of our translation strategy for hallucination detection, demonstrating its applicability regardless of the source language.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 19 references that are in the map. First posted on arXiv 4 Mar 2025.

Builds on

10 of 19 references.

References · 10

  1. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  2. 2023The Internal State of an LLM Knows When It's Lyingcited by 644
  3. 2021QuestEval: Summarization Asks for Fact-based Evaluationcited by 241
  4. 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 233
  5. 2023Hallucinations in Large Multilingual Translation Modelscited by 126
  6. 2023Detecting and Mitigating Hallucinations in Multilingual Summarisationcited by 48
  7. 2024Detecting Hallucinations in Large Language Model Generation: A Token Probability Approachcited by 40
  8. 2023HalOmi: A Manually Annotated Benchmark for Multilingual Hallucination and Omission Detection in Machine Translationcited by 35
  9. 2024SemEval-2024 Shared Task 6: SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakescited by 24
  10. 2024Comparing Hallucination Detection Metrics for Multilingual Generationcited by 18

Built on by

Not cited yet.