mlsanityData to 14 Oct 2026

Unifying Corroborative and Contributive Attributions in Large Language Models

arXiv 2311.12233 ↗First posted 20 Nov 2023cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

As businesses, products, and services spring up around large language models, the trustworthiness of these models hinges on the verifiability of their outputs. However, methods for explaining language model outputs largely fall across two distinct fields of study which both use the term "attribution" to refer to entirely separate techniques: citation generation and training data attribution. In many modern applications, such as legal document generation and medical question answering, both types of attributions are important. In this work, we argue for and present a unified framework of large language model attributions. We show how existing methods of different types of attribution fall under the unified framework. We also use the framework to discuss real-world use cases where one or both types of attributions are required. We believe that this unified framework will guide the use case driven development of systems that leverage both types of attribution, as well as the standardization of their evaluation.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 80 of its 118 references that are in the map. First posted on arXiv 20 Nov 2023.

Builds on

80 of 118 references.

References · 80

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  4. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  7. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  8. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
  9. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  10. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  11. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  12. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
38 more
  1. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  2. 2022Large Language Models Encode Clinical Knowledgecited by 1,830
  3. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  4. 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
  5. 2022LaMDA: Language Models for Dialog Applicationscited by 1,220
  6. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  7. 2022When Not to Trust Language Models: Investigating Effectiveness of Parametric and Non-Parametric Memoriescited by 1,128
  8. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  9. 2016Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyondcited by 812
  10. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
  11. 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
  12. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  13. 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
  14. 2019ELI5: Long Form Question Answeringcited by 575
  15. 2022BioGPT: Generative Pre-trained Transformer for Biomedical Text Generation and Miningcited by 538
  16. 2018Wizard of Wikipedia: Knowledge-Powered Conversational agentscited by 530
  17. 2020What Neural Networks Memorize and Why: Discovering the Long Tail via Influence Estimationcited by 497
  18. 2021Large Dual Encoders Are Generalizable Retrieverscited by 456
  19. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 384
  20. 2021A Survey on Automated Fact-Checkingcited by 378
  21. 2023LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Modelscited by 336
  22. 2023Studying Large Language Model Generalization with Influence Functionscited by 326
  23. 2023Evaluating Verifiability in Generative Search Enginescited by 303
  24. 2022Teaching language models to support answers with verified quotescited by 292
  25. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 287
  26. 2023TRAK: Attributing Model Behavior at Scalecited by 283
  27. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 268
  28. 2021Measuring Attribution in Natural Language Generation Modelscited by 256
  29. 2020Questioning the AI: Informing Design Practices for Explainable AI User Experiencescited by 253
  30. 2020Influence Functions in Deep Learning Are Fragilecited by 252
  31. 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 234
  32. 2023Large Language Models in Finance: A Surveycited by 226
  33. 2022Can large language models reason about medical questions?cited by 194
  34. 2022Datamodels: Predicting Predictions from Training Datacited by 189
  35. 2018Representer Point Selection for Explaining Deep Neural Networkscited by 187
  36. 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
  37. 2020Open-Domain Question Answering Goes Conversational via Question Rewritingcited by 148
  38. 2019On the Accuracy of Influence Functions for Measuring Group Effectscited by 147

50 most cited of 80 All 80 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 6; 2025: 4.

10 papers.