Unifying Corroborative and Contributive Attributions in Large Language Models
Not on the map. Why?
Abstract (arXiv)
As businesses, products, and services spring up around large language models, the trustworthiness of these models hinges on the verifiability of their outputs. However, methods for explaining language model outputs largely fall across two distinct fields of study which both use the term "attribution" to refer to entirely separate techniques: citation generation and training data attribution. In many modern applications, such as legal document generation and medical question answering, both types of attributions are important. In this work, we argue for and present a unified framework of large language model attributions. We show how existing methods of different types of attribution fall under the unified framework. We also use the framework to discuss real-world use cases where one or both types of attributions are required. We believe that this unified framework will guide the use case driven development of systems that leverage both types of attribution, as well as the standardization of their evaluation.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 80 of its 118 references that are in the map. First posted on arXiv 20 Nov 2023.
Builds on
80 of 118 references.
References · 80
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
38 more
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
- 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
- 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 812
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
- 2023Enabling Large Language Models to Generate Text with Citationscited by 595
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
- 2019ELI5: Long Form Question Answeringcited by 575
- 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
- 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
- 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 497
- 2021Large Dual Encoders Are Generalizable Retrieverscited by 456
- 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 384
- 2021A Survey on Automated Fact-Checkingcited by 378
- 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 336
- 2023Studying Large Language Model Generalization with Influence Functionscited by 326
- 2023Evaluating Verifiability in Generative Search Enginescited by 303
- 2022Teaching language models to support answers with verified quotescited by 292
- 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 287
- 2023TRAK: Attributing Model Behavior at Scalecited by 283
- 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 268
- 2021Measuring Attribution in Natural Language Generation Modelscited by 256
- 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 253
- 2020Influence Functions in Deep Learning Are Fragilecited by 252
- 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 234
- 2023Large Language Models in Finance: A Surveycited by 226
- 2022Can large language models reason about medical questions?cited by 194
- 2022Datamodels: Predicting Predictions from Training Datacited by 189
- 2018Representer Point Selection for Explaining Deep Neural Networkscited by 187
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
- 2020Open-Domain Question Answering Goes Conversational via Question Rewritingcited by 148
- 2019On the Accuracy of Influence Functions for Measuring Group Effectscited by 147
50 most cited of 80 All 80 (JSON)
Built on by
Citing papers per year: 2024: 6; 2025: 4.
10 papers.
- 2024Rethinking Interpretability in the Era of Large Language Modelscited by 111
- 2024ContextCite: Attributing Model Generation to Contextcited by 98
- 2024What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functionscited by 94
- 2024Adversarial Search Engine Optimization for Large Language Modelscited by 40
- 2025SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Modelscited by 20
- 2025Learning to Attribute with Attentioncited by 13
- 2025Attributing Response to Context: A Jensen-Shannon Divergence Driven Mechanistic Study of Context Attribution in Retrieval-Augmented Generationcited by 12
- 2024Data Debiasing with Datamodels (D3M): Improving Subgroup Robustness via Data Selectioncited by 5
- 2025GenerationPrograms: Fine-grained Attribution with Executable Programscited by 4
- 2024Fast Training Dataset Attribution via In-Context Learningcited by 2
- 2025GenerationPrograms: Fine-grained Attribution with Executable Programs17 Jun 2025
- 2025Attributing Response to Context: A Jensen-Shannon Divergence Driven Mechanistic Study of Context Attribution in Retrieval-Augmented Generation22 May 2025
- 2025Learning to Attribute with Attention18 Apr 2025
- 2025SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models13 Feb 2025
- 2024ContextCite: Attributing Model Generation to Context1 Sep 2024
- 2024Fast Training Dataset Attribution via In-Context Learning14 Aug 2024
- 2024Adversarial Search Engine Optimization for Large Language Models26 Jun 2024
- 2024Data Debiasing with Datamodels (D3M): Improving Subgroup Robustness via Data Selection24 Jun 2024
- 2024What is Your Data Worth to GPT? LLM-Scale Data Valuation with Influence Functions22 May 2024
- 2024Rethinking Interpretability in the Era of Large Language Models30 Jan 2024