mlsanityData to 14 Oct 2026

A Survey of Large Language Models Attribution

arXiv 2311.03731 ↗First posted 7 Nov 2023cs.CLcited by 71

Not on the map. Why?

Abstract (arXiv)

Open-domain generative systems have gained significant attention in the field of conversational AI (e.g., generative search engines). This paper presents a comprehensive review of the attribution mechanisms employed by these systems, particularly large language models. Though attribution or citation improve the factuality and verifiability, issues like ambiguous knowledge reservoirs, inherent biases, and the drawbacks of excessive attribution can hinder the effectiveness of these systems. The aim of this survey is to provide valuable insights for researchers, aiding in the refinement of attribution methodologies to enhance the reliability and veracity of responses generated by open-domain generative systems. We believe that this field is still in its early stages; hence, we maintain a repository to keep track of ongoing studies at https://github.com/HITsz-TMG/awesome-llm-attributions.

Key facts. Cited by 71 papers in the map (data through 14 Oct 2026). Builds on 47 of its 77 references that are in the map. First posted on arXiv 7 Nov 2023.

Builds on

47 of 77 references.

References · 47

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  4. 2015A large annotated corpus for learning natural language inferencecited by 1,847
  5. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  6. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  7. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  8. 2021Improving language models by retrieving from trillions of tokenscited by 1,293
  9. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  10. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  11. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,210
  12. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
35 more
  1. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  2. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 763
  3. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 695
  4. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
  5. 2023The Internal State of an LLM Knows When It's Lyingcited by 659
  6. 2020Towards Faithfully Interpretable NLP Systems: How should we define and evaluate faithfulness?cited by 599
  7. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  8. 2022Improving alignment of dialogue agents via targeted human judgementscited by 531
  9. 2021A Survey on Automated Fact-Checkingcited by 378
  10. 2023A Survey of Hallucination in Large Foundation Modelscited by 368
  11. 2023Evaluating Verifiability in Generative Search Enginescited by 303
  12. 2022Teaching language models to support answers with verified quotescited by 292
  13. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 287
  14. 2021Measuring Attribution in Natural Language Generation Modelscited by 256
  15. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
  16. 2022Transformer Memory as a Differentiable Search Indexcited by 247
  17. 2022Rethinking with Retrieval: Faithful Large Language Model Inferencecited by 145
  18. 2023WiCE: Real-World Entailment for Claims in Wikipediacited by 120
  19. 2023Do Language Models Know When They're Hallucinating References?cited by 116
  20. 2023Complex Claim Verification with Evidence Retrieved in the Wildcited by 110
  21. 2023WebCPM: Interactive Web Search for Chinese Long-form Question Answeringcited by 93
  22. 2019Incorporating Priors with Feature Attribution on Text Classificationcited by 68
  23. 2023Understanding Retrieval Augmentation for Long-Form Question Answeringcited by 45
  24. 2023"According to ...": Prompting Language Models Improves Quoting from Pre-Training Datacited by 42
  25. 2022ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Datacited by 34
  26. 2023Retrieving Supporting Evidence for Generative Question Answeringcited by 31
  27. 2023Towards Verifiable Generation: A Benchmark for Knowledge-aware Language Model Attributioncited by 24
  28. 2022CiteBench: A benchmark for Scientific Citation Text Generationcited by 22
  29. 2023Evaluating and Modeling Attribution for Cross-Lingual Question Answeringcited by 21
  30. 2023Quantifying and Attributing the Hallucination of Large Language Models via Association Analysiscited by 15
  31. 2021Unifying Model Explainability and Robustness for Joint Text Classification and Rationale Extractioncited by 11
  32. 2023Towards Reliable and Fluent Large Language Models: Incorporating Feedback Learning Loops in QA Systemscited by 10
  33. 2021Towards Generating Citation Sentences for Multiple References with Intent Controlcited by 9
  34. 20231-PAGER: One Pass Answer Generation and Evidence Retrievalcited by 7
  35. 2017Finding News Citations for Wikipediacited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 33; 2025: 27; 2026: 8.

71 papers.

Sort:

By area:

  1. 2024Rethinking Machine Unlearning for Large Language Modelscited by 257
  2. 2024A Comprehensive Study of Knowledge Editing for Large Language Modelscited by 163
  3. 2024Summary of a Haystack: A Challenge to Long-Context LLMs and RAG Systemscited by 87
  4. 2024Trustworthiness in Retrieval-Augmented Generation Systems: A Surveycited by 83
  5. 2023LLatrieval: LLM-Verified Retrieval for Verifiable Generationcited by 52
  6. 2024Training Language Models to Generate Text with Citations via Fine-grained Rewardscited by 42
  7. 2024Measuring and Enhancing Trustworthiness of LLMs in RAG through Grounded Attributions and Learning to Refusecited by 34
  8. 2024Source-Aware Training Enables Knowledge Attribution in Language Modelscited by 30
  9. 2024Making Long-Context Language Models Better Multi-Hop Reasonerscited by 26
  10. 2024Peering into the Mind of Language Models: An Approach for Attribution in Contextual Question Answeringcited by 25
  11. 2024Improving Attributed Text Generation of Large Language Models via Preference Learningcited by 23
  12. 2024A Survey of Conversational Searchcited by 22
38 more
  1. 2023Towards Verifiable Text Generation with Evolving Memory and Self-Reflectioncited by 21
  2. 2024Position: Leverage Foundational Models for Black-Box Optimizationcited by 21
  3. 2024Atomic Fact Decomposition Helps Attributed Question Answeringcited by 21
  4. 2024Correctness is not Faithfulness in RAG Attributionscited by 18
  5. 2024Can LLMs Evaluate Complex Attribution in QA? Automatic Benchmarking using Knowledge Graphscited by 17
  6. 2024PLD+: Accelerating LLM inference by leveraging Language Model Artifactscited by 17
  7. 2024CitaLaw: Enhancing LLM with Citations in Legal Domaincited by 16
  8. 2025LongFaith: Enhancing Long-Context Reasoning in LLMs with Faithful Synthetic Datacited by 16
  9. 2025FinRAGBench-V: A Benchmark for Multimodal RAG with Visual Citation in the Financial Domaincited by 16
  10. 2025Resolving Conflicting Evidence in Automated Fact-Checking: A Study on Retrieval-Augmented LLMscited by 16
  11. 2024ALiiCE: Evaluating Positional Fine-grained Citation Generationcited by 15
  12. 2025TokenShapley: Token Level Context Attribution with Shapley Valuecited by 15
  13. 2024Advancing Large Language Model Attribution through Self-Improvingcited by 14
  14. 2024LitLLMs, LLMs for Literature Review: Are we there yet?cited by 14
  15. 2024Learning Fine-Grained Grounded Citations for Attributed Large Language Modelscited by 13
  16. 2025Training a Utility-based Retriever Through Shared Context Attribution for Retrieval-Augmented Language Modelscited by 13
  17. 2024Towards Faithful and Robust LLM Specialists for Evidence-Based Question-Answeringcited by 11
  18. 2023Unifying Corroborative and Contributive Attributions in Large Language Modelscited by 10
  19. 2024Evidence Contextualization and Counterfactual Attribution for Conversational QA over Heterogeneous Data with RAG Systemscited by 8
  20. 2024WebCiteS: Attributed Query-Focused Summarization on Chinese Web Search Results with Citationscited by 7
  21. 2024Groundedness in Retrieval-augmented Long-form Generation: An Empirical Studycited by 7
  22. 2025Attribution, Citation, and Quotation: A Survey of Evidence-based Text Generation with Large Language Modelscited by 7
  23. 2025FitCF: A Framework for Automatic Feature Importance-guided Counterfactual Example Generationcited by 6
  24. 2024Citekit: A Modular Toolkit for Large Language Model Citation Generationcited by 5
  25. 2024L-CiteEval: Do Long-Context Models Truly Leverage Context for Responding?cited by 5
  26. 2024Attention with Dependency Parsing Augmentation for Fine-Grained Attributioncited by 5
  27. 2025Unstructured Evidence Attribution for Long Context Query Focused Summarizationcited by 5
  28. 2025KnowThyself: An Agentic Assistant for LLM Interpretabilitycited by 5
  29. 2025Follow the Flow: Fine-grained Flowchart Attribution with Neurosymbolic Agentscited by 4
  30. 2024Neurosymbolic AI approach to Attribution in Large Language Modelscited by 3
  31. 2024An Adaptive Framework for Generating Systematic Explanatory Answer in Online Q&A Platformscited by 3
  32. 2025ChartLens: Fine-grained Visual Attribution in Chartscited by 3
  33. 2025The Attribution Crisis in LLM Search Resultscited by 3
  34. 2026Addressing Corpus Knowledge Poisoning Attacks on RAG Using Sparse Attentioncited by 3
  35. 2024Model Attribution in LLM-Generated Disinformation: A Domain Generalization Approach with Supervised Contrastive Learningcited by 2
  36. 2025Agentic Verification for Ambiguous Query Disambiguationcited by 2
  37. 2025Contrastive Speaker-Aware Learning for Multi-party Dialogue Generation with LLMscited by 2
  38. 2025On Synthesizing Data for Context Attribution in Question Answeringcited by 2

50 most cited of 71 All 71 (JSON)