mlsanityData to 7 Oct 2026

Towards Verifiable Text Generation with Evolving Memory and Self-Reflection

arXiv 2312.09075 ↗First posted 14 Dec 2023cs.CLcited by 21

Not on the map. Why?

Abstract (arXiv)

Despite the remarkable ability of large language models (LLMs) in language comprehension and generation, they often suffer from producing factually incorrect information, also known as hallucination. A promising solution to this issue is verifiable text generation, which prompts LLMs to generate content with citations for accuracy verification. However, verifiable text generation is non-trivial due to the focus-shifting phenomenon, the intricate reasoning needed to align the claim with correct citations, and the dilemma between the precision and breadth of retrieved documents. In this paper, we present VTG, an innovative framework for Verifiable Text Generation with evolving memory and self-reflection. VTG introduces evolving long short-term memory to retain both valuable documents and recent documents. A two-tier verifier equipped with an evidence finder is proposed to rethink and reflect on the relationship between the claim and citations. Furthermore, active retrieval and diverse query generation are utilized to enhance both the precision and breadth of the retrieved documents. We conduct extensive experiments on five datasets across three knowledge-intensive tasks and the results reveal that VTG significantly outperforms baselines.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 37 of its 44 references that are in the map. First posted on arXiv 14 Dec 2023.

Builds on

37 of 44 references.

References · 37

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  7. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  8. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  9. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  10. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  11. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  12. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
25 more
  1. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  2. 2022Galactica: A Large Language Model for Sciencecited by 736
  3. 2023In-Context Retrieval-Augmented Language Modelscited by 694
  4. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 691
  5. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  6. 2019ELI5: Long Form Question Answeringcited by 567
  7. 2023Evaluating Verifiability in Generative Search Enginescited by 297
  8. 2022Generate rather than Retrieve: Large Language Models are Strong Context Generatorscited by 296
  9. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 286
  10. 2021Measuring Attribution in Natural Language Generation Modelscited by 253
  11. 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 231
  12. 2023Chain-of-Note: Enhancing Robustness in Retrieval-Augmented Language Modelscited by 180
  13. 2023WebGLM: Towards An Efficient Web-Enhanced Question Answering System with Human Preferencescited by 100
  14. 2023WebCPM: Interactive Web Search for Chinese Long-form Question Answeringcited by 93
  15. 2023Improving Language Models via Plug-and-Play Retrieval Feedbackcited by 87
  16. 2023Learning to Filter Context for Retrieval-Augmented Generationcited by 82
  17. 2023Augmentation-Adapted Retriever Improves Generalization of Language Models as Generic Plug-Incited by 71
  18. 2023A Survey of Large Language Models Attributioncited by 71
  19. 2023Merging Generated and Retrieved Knowledge for Open-Domain QAcited by 36
  20. 2023Towards Verifiable Generation: A Benchmark for Knowledge-aware Language Model Attributioncited by 24
  21. 2022CiteBench: A benchmark for Scientific Citation Text Generationcited by 22
  22. 2023Small Language Models Fine-tuned to Coordinate Larger Language Models improve Complex Reasoningcited by 16
  23. 2023Allies: Prompting Large Language Model with Beam Searchcited by 6
  24. 2023History Semantic Graph Enhanced Conversational KBQA with Temporal Information Modelingcited by 4
  25. 2023Optimizing Factual Accuracy in Text Generation through Dynamic Knowledge Selectioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 10; 2025: 5; 2026: 6.

21 papers.

Sort:

By area:

  1. 2024Tool Learning with Large Language Models: A Surveycited by 221
  2. 2024From Matching to Generation: A Survey on Generative Information Retrievalcited by 89
  3. 2024Trustworthiness in Retrieval-Augmented Generation Systems: A Surveycited by 83
  4. 2024AttriBoT: A Bag of Tricks for Efficiently Approximating Leave-One-Out Context Attributioncited by 23
  5. 2024A Survey of Conversational Searchcited by 22
  6. 2024ShapefileGPT: A Multi-Agent Large Language Model Framework for Automated Shapefile Processingcited by 9
  7. 2025VeriCite: Towards Reliable Citations in Retrieval-Augmented Generation via Rigorous Verificationcited by 8
  8. 2024textttLM^texttt2: A Simple Society of Language Models Solves Complex Reasoningcited by 7
  9. 2025Large Language Model Sourcing: A Surveycited by 5
  10. 2025Transparentize the Internal and External Knowledge Utilization in LLMs with Trustworthy Citationcited by 4
  11. 2026Steering the Verifiability of Multimodal AI Hallucinationscited by 4
  12. 2024Boosting Disfluency Detection with Large Language Model as Disfluency Generatorcited by 2
9 more
  1. 2024A Comparative Analysis of Faithfulness Metrics and Humans in Citation Evaluationcited by 2
  2. 2026HingeMem: Boundary Guided Long-Term Memory with Query Adaptive Retrieval for Scalable Dialoguescited by 2
  3. 2024Rate, Explain and Cite (REC): Enhanced Explanation and Attribution in Automatic Evaluation by Large Language Modelscited by 1
  4. 2025Issue Retrieval and Verification Enhanced Supplementary Code Comment Generationcited by 0
  5. 2026Robust Uncertainty Quantification for Factual Generation of Large Language Modelscited by 0
  6. 2026Attribution Techniques for Mitigating Hallucinated Information in RAG Systems: A Surveycited by 0
  7. 2025C2-Cite: Contextual-Aware Citation Generation for Attributed Large Language Modelscited by 0
  8. 2026Query-Focused Event Summarization: A Dataset and Benchmarkcited by 0
  9. 2026A Citation-Grounded Benchmark for Trustworthy Earnings Call Transcript Analysis with Large Language Modelscited by 0