Representer Point Selection for Explaining Deep Neural Networks
Not on the map. Why?
Abstract (arXiv)
We propose to explain the predictions of a deep neural network, by pointing to the set of what we call representer points in the training set, for a given test point prediction. Specifically, we show that we can decompose the pre-activation prediction of a neural network into a linear combination of activations of training points, with the weights corresponding to what we call representer values, which thus capture the importance of that training point on the learned parameters of the network. But it provides a deeper understanding of the network than simply training point influence: with positive representer values corresponding to excitatory training points, and negative values corresponding to inhibitory points, which as we show provides considerably more insight. Our method is also much more scalable, allowing for real-time feedback in a manner not feasible with influence functions.
Key facts. Cited by 187 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 35; 2022: 27; 2023: 31; 2024: 36; 2025: 33; 2026: 25.
187 papers.
Sort:
By area:
- 2023Explainability for Large Language Models: A Surveycited by 333
- 2023TRAK: Attributing Model Behavior at Scalecited by 283
- 2022Datamodels: Predicting Predictions from Training Datacited by 189
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
- 2022If Influence Functions are the Answer, Then What is the Question?cited by 144
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 135
- 2021Scaling Up Influence Functionscited by 132
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2021HIVE: Evaluating the Human Interpretability of Visual Explanationscited by 105
- 2021Towards a Science of Human-AI Decision Making: A Survey of Empirical Studiescited by 86
- 2021Input Similarity from the Neural Network Perspectivecited by 79
- 2023Fast Model Debias with Machine Unlearningcited by 72
38 more
- 2022"Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interactioncited by 63
- 2022Post hoc Explanations may be Ineffective for Detecting Unknown Spurious Correlationcited by 59
- 2022PUMA: Performance Unchanged Model Augmentation for Training Data Removalcited by 58
- 2022Leveraging Explanations in Interactive Machine Learning: An Overviewcited by 53
- 2023Simfluence: Modeling the Influence of Individual Training Examples by Simulating Training Runscited by 53
- 2023SHAP-IQ: Unified Approximation of any-order Shapley Interactionscited by 51
- 2022Measuring the Effect of Training Data on Deep Learning Predictions via Randomized Experimentscited by 50
- 2021Interactive Label Cleaning with Example-based Explanationscited by 49
- 2023Intriguing Properties of Data Attribution on Diffusion Modelscited by 47
- 2023The Journey, Not the Destination: How Data Guides Diffusion Modelscited by 43
- 2021Revisiting Methods for Finding Influential Examplescited by 39
- 2021HYDRA: Hypergradient Data Relevance Analysis for Interpreting Deep Neural Networkscited by 38
- 2021Combining Feature and Instance Attribution to Detect Artifactscited by 38
- 2021DISSECT: Disentangled Simultaneous Explanations via Concept Traversalscited by 37
- 2023Self-Influence Guided Data Reweighting for Language Model Pre-trainingcited by 37
- 2021An Empirical Comparison of Instance Attribution Methods for NLPcited by 35
- 2022First is Better Than Last for Language Data Influencecited by 34
- 2022ORCA: Interpreting Prompted Language Models via Locating Supporting Data Evidence in the Ocean of Pretraining Datacited by 34
- 2024Training Data Attribution via Approximate Unrolled Differentiationcited by 34
- 2022Identifying a Training-Set Attack's Target Using Renormalized Influence Estimationcited by 32
- 2024Most Influential Subset Selection: Challenges, Promises, and Beyondcited by 32
- 2021Explaining Latent Representations with a Corpus of Examplescited by 30
- 2021Interpretable Data-Based Explanations for Fairness Debuggingcited by 30
- 2021Influence Tuning: Demoting Spurious Correlations via Instance Attribution and Instance-Driven Updatescited by 27
- 2022Data-Efficient Finetuning Using Cross-Task Nearest Neighborscited by 26
- 2022Human-Centered Concept Explanations for Neural Networkscited by 23
- 2022Understanding Influence Functions and Datamodels via Harmonic Analysiscited by 23
- 2024Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Modelscited by 22
- 2021Understanding Instance-based Interpretability of Variational Auto-Encoderscited by 21
- 2026OPUS: Towards Efficient and Principled Data Selection in Large Language Model Pre-training in Every Iterationcited by 21
- 2022Challenges in Applying Explainability Methods to Improve the Fairness of NLP Modelscited by 20
- 2022Concept Gradient: Concept-based Interpretation Without Linear Assumptioncited by 20
- 2023Identification of Negative Transfers in Multitask Learning Using Surrogate Modelscited by 20
- 2024Token-wise Influential Training Data Retrieval for Large Language Modelscited by 20
- 2022Attribute Prototype Network for Any-Shot Learningcited by 19
- 2022Use-Case-Grounded Simulations for Explanation Evaluationcited by 19
- 2024Evolving Interpretable Visual Classifiers with Large Language Modelscited by 18
- 2024textttdattri: A Library for Efficient Data Attributioncited by 18
50 most cited of 187 All 187 (JSON)
- 2026Certified Approximation for Interpretable Representer Landmarks30 Sep 2026
- 2026dattri-LLM: A Unified and Efficient Library for Training Data Attribution at LLM Scale30 Sep 2026
- 2026Which Influence Are We Estimating? The Role of Counterfactual Specifications in Data Attribution25 Sep 2026
- 2026"World Knowledge" in the Weights: Reading Concept Circuits of Vision Transformers8 Sep 2026
- 2026Vision: Data-Centric Anchoring for Robust and Interpretable Agentic AI8 Sep 2026
- 2026What Does Animal Re-Identification Learn? Linear Biological Concepts and Their Origins in Visual Representations5 Sep 2026
- 2026Traceable Spectral Inference via Influence Functions: Efficient Data Attribution and Error Proxies for the Ariel Mission24 Aug 2026
- 2026More Data, Worse Decisions? Preference Reversals in Neural Networks under Gram Incompatibility28 Jul 2026
- 2026Fisher Rank Inflation: A Spectral Signature of Memorization under Label Noise14 Jul 2026
- 2026Do Neural Networks Preserve Case Structure? Case-Based Decomposition, Interpretation, and Decision Consistency13 Jul 2026
- 2026Bergson: An Open Source Library for Data Attribution10 Jun 2026
- 2026GRASP: Geometry-aware Residual Alignment for Scalable Pretraining Data Attribution5 Jun 2026
38 more
- 2026STRIDE: Training Data Attribution via Sparse Recovery from Subset Perturbations3 Jun 2026
- 2026PRISM: Preference-Aware Influence Function Based Data Selection Method for Efficient Fine-Tuning20 May 2026
- 2026Dynamic Shapley Computation20 May 2026
- 2026GRACE: Gradient-aligned Reasoning Data Curation for Efficient Post-training13 May 2026
- 2026Is Data Shapley Not Better than Random in Data Selection? Ask NASH11 May 2026
- 2026SCARV: Structure-Constrained Aggregation for Stable Sample Ranking in Redundant NLP Datasets1 May 2026
- 2026Randomized Antipodal Search Done Right for Data Pareto Improvement of LLM Unlearning17 Apr 2026
- 2026Learning from the Right Rollouts: Data Attribution for PPO-based LLM Post-Training2 Apr 2026
- 2026OPUS: Towards Efficient and Principled Data Selection in Large Language Model Pre-training in Every Iteration5 Feb 2026
- 2026LoRIF: Low-Rank Influence Functions for Scalable Training Data Attribution29 Jan 2026
- 2026Process-Tensor Tomography of SGD: Measuring Non-Markovian Memory via Back-Flow of Distinguishability23 Jan 2026
- 2026Responsible AI for General-Purpose Systems: Overview, Challenges, and A Path Forward19 Jan 2026
- 2026Compact Example-Based Explanations for Language Models7 Jan 2026
- 2025Shapley-based Data Valuation for LLM Alignment via Sequential Preference Optimization12 Dec 2025
- 2025PARIS: Pruning Algorithm via the Representer theorem for Imbalanced Scenarios7 Dec 2025
- 2025Scalable Data Attribution via Forward-Only Test-Time Inference25 Nov 2025
- 2025First is Not Really Better Than Last: Evaluating Layer Choice and Aggregation Strategies in Language Model Data Influence Estimation6 Nov 2025
- 2025Sparse, self-organizing ensembles of local kernels detect rare statistical anomalies5 Nov 2025
- 2025UtilGen: Utility-Centric Generative Data Augmentation with Dual-Level Task Adaptation28 Oct 2025
- 2025Adaptive Data Selection for Multi-Layer Perceptron Training: A Sub-linear Value-Driven Method24 Oct 2025
- 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models7 Oct 2025
- 2025What Is The Performance Ceiling of My Classifier? Utilizing Category-Wise Influence Functions for Pareto Frontier Analysis4 Oct 2025
- 2025Interpretable Self-Supervised Learning via Representer Landmarks and Nystr"om Approximation29 Sep 2025
- 2025Exploring Training Data Attribution under Limited Access Constraints16 Sep 2025
- 2025CUBE: Contrastive Understanding by Balanced Experiments13 Sep 2025
- 2025GCAV: A Global Concept Activation Vector Framework for Cross-Layer Consistency in Interpretability28 Aug 2025
- 2025Coresets from Trajectories: Selecting Data via Correlation of Loss Differences27 Aug 2025
- 2025Efficiently Verifiable Proofs of Data Attribution14 Aug 2025
- 2025Revisiting Data Attribution for Influence Functions10 Aug 2025
- 2025Better Training Data Attribution via Better Inverse Hessian-Vector Products19 Jul 2025
- 2025Disentangling the Roles of Representation and Selection in Data Pruning4 Jul 2025
- 2025GRASP-PsONet: Gradient-based Removal of Spurious Patterns for PsOriasis Severity Classification27 Jun 2025
- 2025A Comparative Analysis of Influence Signals for Data Debugging13 Jun 2025
- 2025Learning to Weight Parameters for Training Data Attribution6 Jun 2025
- 2025Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety5 Jun 2025
- 2025Fast-DataShapley: Neural Modeling for Training Data Valuation5 Jun 2025
- 2025LayerIF: Estimating Layer Quality for Large Language Models using Influence Functions27 May 2025
- 2025Measuring Fine-Grained Relatedness in Multitask Learning via Data Attribution27 May 2025
50 newest of 187 All 187 (JSON)
- 2023Intriguing Properties of Data Attribution on Diffusion Modelscited by 47
- 2023The Journey, Not the Destination: How Data Guides Diffusion Modelscited by 43
- 2024Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Modelscited by 22
- 2024Data Attribution for Diffusion Models: Timestep-induced Bias in Influence Estimationcited by 14
- 2025Image Interpolation with Score-based Riemannian Metrics of Diffusion Modelscited by 4
- 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Modelscited by 3
- 2025Be Tangential to Manifold: Discovering Riemannian Metric for Diffusion Models7 Oct 2025
- 2025Image Interpolation with Score-based Riemannian Metrics of Diffusion Models28 Apr 2025
- 2024Diffusion Attribution Score: Evaluating Training Data Influence in Diffusion Models24 Oct 2024
- 2024Data Attribution for Diffusion Models: Timestep-induced Bias in Influence Estimation17 Jan 2024
- 2023The Journey, Not the Destination: How Data Guides Diffusion Models11 Dec 2023
- 2023Intriguing Properties of Data Attribution on Diffusion Models1 Nov 2023
- 2023Fast Model Debias with Machine Unlearningcited by 72
- 2025Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safetycited by 10
- 2025FUNU: Boosting Machine Unlearning Efficiency by Filtering Unnecessary Unlearningcited by 7
- 2026Randomized Antipodal Search Done Right for Data Pareto Improvement of LLM Unlearningcited by 2
- 2026Randomized Antipodal Search Done Right for Data Pareto Improvement of LLM Unlearning17 Apr 2026
- 2025Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety5 Jun 2025
- 2025FUNU: Boosting Machine Unlearning Efficiency by Filtering Unnecessary Unlearning28 Jan 2025
- 2023Fast Model Debias with Machine Unlearning19 Oct 2023
- 2023Explainability for Large Language Models: A Surveycited by 333
- 2023TRAK: Attributing Model Behavior at Scalecited by 283
- 2022Datamodels: Predicting Predictions from Training Datacited by 189
- 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 156
- 2022If Influence Functions are the Answer, Then What is the Question?cited by 144
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 135
- 2021Scaling Up Influence Functionscited by 132
- 2021Human-Centered Explainable AI (XAI): From Algorithms to User Experiencescited by 123
- 2021HIVE: Evaluating the Human Interpretability of Visual Explanationscited by 105
- 2021Towards a Science of Human-AI Decision Making: A Survey of Empirical Studiescited by 86
- 2021Input Similarity from the Neural Network Perspectivecited by 79
- 2022"Help Me Help the AI": Understanding How Explainability Can Support Human-AI Interactioncited by 63
12 most cited of 172 All 172 (JSON)
- 2026Certified Approximation for Interpretable Representer Landmarks30 Sep 2026
- 2026dattri-LLM: A Unified and Efficient Library for Training Data Attribution at LLM Scale30 Sep 2026
- 2026Which Influence Are We Estimating? The Role of Counterfactual Specifications in Data Attribution25 Sep 2026
- 2026What Does Animal Re-Identification Learn? Linear Biological Concepts and Their Origins in Visual Representations5 Sep 2026
- 2026Traceable Spectral Inference via Influence Functions: Efficient Data Attribution and Error Proxies for the Ariel Mission24 Aug 2026
- 2026More Data, Worse Decisions? Preference Reversals in Neural Networks under Gram Incompatibility28 Jul 2026
- 2026Fisher Rank Inflation: A Spectral Signature of Memorization under Label Noise14 Jul 2026
- 2026Do Neural Networks Preserve Case Structure? Case-Based Decomposition, Interpretation, and Decision Consistency13 Jul 2026
- 2026Bergson: An Open Source Library for Data Attribution10 Jun 2026
- 2026GRASP: Geometry-aware Residual Alignment for Scalable Pretraining Data Attribution5 Jun 2026
- 2026STRIDE: Training Data Attribution via Sparse Recovery from Subset Perturbations3 Jun 2026
- 2026PRISM: Preference-Aware Influence Function Based Data Selection Method for Efficient Fine-Tuning20 May 2026
12 newest of 172 All 172 (JSON)