mlsanityData to 7 Oct 2026

Will It Still Be True Tomorrow? Multilingual Evergreen Question Classification to Improve Trustworthy QA

arXiv 2505.21115 ↗First posted 27 May 2025cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) often hallucinate in question answering (QA) tasks. A key yet underexplored factor contributing to this is the temporality of questions -- whether they are evergreen (answers remain stable over time) or mutable (answers change). In this work, we introduce EverGreenQA, the first multilingual QA dataset with evergreen labels, supporting both evaluation and training. Using EverGreenQA, we benchmark 12 modern LLMs to assess whether they encode question temporality explicitly (via verbalized judgments) or implicitly (via uncertainty signals). We also train EG-E5, a lightweight multilingual classifier that achieves SoTA performance on this task. Finally, we demonstrate the practical utility of evergreen classification across three applications: improving self-knowledge estimation, filtering QA datasets, and explaining GPT-4o retrieval behavior.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 31 of its 55 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

31 of 55 references.

References · 31

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  5. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  6. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  7. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  8. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  9. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  10. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
  11. 2020Knowledge Graphscited by 619
  12. 2024Adaptive-RAG: Learning to Adapt Retrieval-Augmented Large Language Models through Question Complexitycited by 437
19 more
  1. 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
  2. 2024Measuring short-form factuality in large language modelscited by 345
  3. 2023FreshLLMs: Refreshing Large Language Models with Search Engine Augmentationcited by 308
  4. 2022RealTime QA: What's the Answer Right Now?cited by 239
  5. 2023Do Large Language Models Know What They Don't Know?cited by 238
  6. 2020Unsupervised Quality Estimation for Neural Machine Translationcited by 210
  7. 2024Fact-Checking the Output of Large Language Models via Token-Level Uncertainty Quantificationcited by 159
  8. 2021A Dataset for Answering Time-Sensitive Questionscited by 150
  9. 2021SituatedQA: Incorporating Extra-Linguistic Contexts into QAcited by 145
  10. 2022StreamingQA: A Benchmark for Adaptation to New Knowledge over Time in Question Answering Modelscited by 123
  11. 2024Benchmarking Uncertainty Quantification Methods for Large Language Models with LM-Polygraphcited by 105
  12. 2023Leveraging GPT-4 for Automatic Translation Post-Editingcited by 56
  13. 2025Adaptive Retrieval Without Self-Knowledge? Bringing Uncertainty Back Homecited by 33
  14. 2024GPT-4 vs. Human Translators: A Comprehensive Evaluation of Translation Quality Across Languages, Domains, and Expertise Levelscited by 20
  15. 2025Token-Level Density-Based Uncertainty Quantification Methods for Eliciting Truthfulness of Large Language Modelscited by 18
  16. 2024Time Sensitive Knowledge Editing through Efficient Finetuningcited by 14
  17. 2025How Much Knowledge Can You Pack into a LoRA Adapter without Harming LLM?cited by 11
  18. 2024MuLan: A Study of Fact Mutability in Language Modelscited by 10
  19. 2024Konstruktor: A Strong Baseline for Simple Knowledge Graph Question Answeringcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

  1. 2026Calibration Is Not Enough: Evaluating Confidence Estimation Under Language Variationscited by 3
  2. 2026Why Don't You Know? Evaluating the Impact of Uncertainty Sources on Uncertainty Quantification in LLMscited by 0
  3. 2026Clarify, Abstain or Answer? Strategising in Conversation with Belief-Augmented Generationcited by 0
  4. 2026OCC-RAG: Optimal Cognitive Core for Faithful Question Answeringcited by 0
  5. 2026Boosting Self-Consistency with Rankingcited by 0