Incorporating Priors with Feature Attribution on Text Classification
Not on the map. Why?
Abstract (arXiv)
Feature attribution methods, proposed recently, help users interpret the predictions of complex models. Our approach integrates feature attributions into the objective function to allow machine learning practitioners to incorporate priors in model building. To demonstrate the effectiveness our technique, we apply it to two tasks: (1) mitigating unintended bias in text classifiers by neutralizing identity terms; (2) improving classifier performance in a scarce data setting by forcing the model to focus on toxic terms. Our approach adds an L2 distance loss between feature attributions and task-specific prior values to the objective. Our experiments show that i) a classifier trained with our technique reduces undesired model biases without a trade off on the original task; ii) incorporating priors helps model performance in scarce data settings.
Key facts. Cited by 68 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 22; 2023: 11; 2024: 10; 2025: 6; 2026: 2.
68 papers.
Sort:
By area:
- 2022The Unreliability of Explanations in Few-shot Prompting for Textual Reasoningcited by 169
- 2024Rethinking Interpretability in the Era of Large Language Modelscited by 110
- 2021EDITS: Modeling and Mitigating Data Bias for Graph Neural Networkscited by 92
- 2022Shortcut Learning of Large Language Models in Natural Language Understandingcited by 83
- 2023Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMscited by 82
- 2023A Survey of Large Language Models Attributioncited by 71
- 2021Fairness via Representation Neutralizationcited by 63
- 2023Explaining black box text modules in natural language with language modelscited by 61
- 2022FairPrune: Achieving Fairness Through Pruning for Dermatological Disease Diagnosiscited by 59
- 2022Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvementcited by 48
- 2022Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Biascited by 43
- 2021Shapley Explanation Networkscited by 41
38 more
- 2022Augmenting Interpretable Models with LLMs during Trainingcited by 36
- 2024InjecGuard: Benchmarking and Mitigating Over-defense in Prompt Injection Guardrail Modelscited by 36
- 2021Fast Axiomatic Attribution for Neural Networkscited by 35
- 2022Going Beyond XAI: A Systematic Survey for Explanation-Guided Learningcited by 35
- 2023TANGOS: Regularizing Tabular Neural Networks through Gradient Orthogonalization and Specializationcited by 32
- 2021Refining Language Models with Compositional Explanationscited by 27
- 2022Aligning Eyes between Humans and Deep Neural Network through Interactive Attention Alignmentcited by 27
- 2021Estimating and Improving Fairness with Adversarial Learningcited by 26
- 2023An Empirical Evaluation of the Rashomon Effect in Explainable Machine Learningcited by 25
- 2021Modeling Techniques for Machine Learning Fairness: A Surveycited by 17
- 2021Enjoy the Salience: Towards Better Transformer-based Faithful Explanations with Word Saliencecited by 16
- 2022The Birth of Bias: A case study on the evolution of gender bias in an English language modelcited by 16
- 2022A survey on improving NLP models with human explanationscited by 15
- 2021Explainable Machine Learning with Prior Knowledge: An Overviewcited by 14
- 2022VisFIS: Visual Feature Importance Supervision with Right-for-the-Right-Reason Objectivescited by 12
- 2021Thermostat: A Large Collection of NLP Model Explanations and Analysis Toolscited by 11
- 2024Crafting Interpretable Embeddings by Asking LLMs Questionscited by 11
- 2021Towards Benchmarking the Utility of Explanations for Model Debuggingcited by 10
- 2022Fairness and Bias in Robot Learningcited by 10
- 2021Efficient Explanations from Empirical Explainerscited by 9
- 2021Exploring Distantly-Labeled Rationales in Neural Network Modelscited by 8
- 2022XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Modelscited by 8
- 2024XEdgeAI: A Human-centered Industrial Inspection Framework with Data-centric Explainable Edge AI Approachcited by 7
- 2022ER-Test: Evaluating Explanation Regularization Methods for Language Modelscited by 6
- 2022Assessing Out-of-Domain Language Model Performance from Few Examplescited by 6
- 2021Double Trouble: How to not explain a text classifier's decisions using counterfactuals synthesized by masked language models?cited by 5
- 2024Exploring the Trade-off Between Model Performance and Explanation Plausibility of Text Classifiers Using Human Rationalescited by 5
- 2022Privileged Attribution Constrained Deep Networks for Facial Expression Recognitioncited by 4
- 2023The Thousand Faces of Explainable AI Along the Machine Learning Life Cycle: Industrial Reality and Current State of Researchcited by 4
- 2023REFER: An End-to-end Rationale Extraction Framework for Explanation Regularizationcited by 4
- 2023Towards Faithful Explanations for Text Classification with Robustness Improvement and Explanation Guided Trainingcited by 4
- 2022Dynamically Refined Regularization for Improving Cross-corpora Hate Speech Detectioncited by 3
- 2023Did the Models Understand Documents? Benchmarking Models for Language Understanding in Document-Level Relation Extractioncited by 3
- 2023Disparity, Inequality, and Accuracy Tradeoffs in Graph Neural Networks for Node Classificationcited by 3
- 2023Dual-Teacher De-biasing Distillation Framework for Multi-domain Fake News Detectioncited by 2
- 2021Regularizing Explanations in Bayesian Convolutional Neural Networkscited by 1
- 2021Interpreting and improving deep-learning models with reality checkscited by 1
- 2021Contrastive Clustering: Toward Unsupervised Bias Reduction for Emotion and Sentiment Classificationcited by 1
50 most cited of 68 All 68 (JSON)
- 2026Steering Neural Network Training through Interpretable Constraints Based on Partial Dependence9 Jul 2026
- 2026ABLE: Representing and Mapping LLMs via Attribution-Based Large-model Embedding20 Apr 2026
- 2025Hybrid Attribution Priors for Explainable and Robust Model Training9 Dec 2025
- 2025Machine Learning from Explanations7 Jul 2025
- 2025Class-Level Feature Selection Method Using Feature Weighted Growing Self-Organising Maps14 Mar 2025
- 2025Large Language Models as Attribution Regularizers for Efficient Model Training27 Feb 2025
- 2025IMPACTX: improving model performance by appropriately constraining the training with teacher explanations17 Feb 2025
- 2025Main Predicate and Their Arguments as Explanation Signals For Intent Classification3 Feb 2025
- 2024InjecGuard: Benchmarking and Mitigating Over-defense in Prompt Injection Guardrail Models30 Oct 2024
- 2024Explanation Regularisation through the Lens of Attributions23 Jul 2024
- 2024XEdgeAI: A Human-centered Industrial Inspection Framework with Data-centric Explainable Edge AI Approach16 Jul 2024
- 2024Model Guidance via Explanations Turns Image Classifiers into Segmentation Models3 Jul 2024
38 more
- 2024The Impact of an XAI-Augmented Approach on Binary Classification with Scarce Data1 Jul 2024
- 2024Crafting Interpretable Embeddings by Asking LLMs Questions26 May 2024
- 2024Exploring the Trade-off Between Model Performance and Explanation Plausibility of Text Classifiers Using Human Rationales3 Apr 2024
- 2024Using Interpretation Methods for Model Enhancement2 Apr 2024
- 2024Towards a general framework for improving the performance of classifiers using XAI methods15 Mar 2024
- 2024Rethinking Interpretability in the Era of Large Language Models30 Jan 2024
- 2023Towards Faithful Explanations for Text Classification with Robustness Improvement and Explanation Guided Training29 Dec 2023
- 2023Dual-Teacher De-biasing Distillation Framework for Multi-domain Fake News Detection2 Dec 2023
- 2023A Survey of Large Language Models Attribution7 Nov 2023
- 2023Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMs3 Nov 2023
- 2023REFER: An End-to-end Rationale Extraction Framework for Explanation Regularization22 Oct 2023
- 2023The Thousand Faces of Explainable AI Along the Machine Learning Life Cycle: Industrial Reality and Current State of Research11 Oct 2023
- 2023Disparity, Inequality, and Accuracy Tradeoffs in Graph Neural Networks for Node Classification18 Aug 2023
- 2023An Empirical Evaluation of the Rashomon Effect in Explainable Machine Learning27 Jun 2023
- 2023Did the Models Understand Documents? Benchmarking Models for Language Understanding in Document-Level Relation Extraction20 Jun 2023
- 2023Explaining black box text modules in natural language with language models17 May 2023
- 2023TANGOS: Regularizing Tabular Neural Networks through Gradient Orthogonalization and Specialization9 Mar 2023
- 2022Bias Mitigation Framework for Intersectional Subgroups in Neural Networks26 Dec 2022
- 2022Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Bias21 Dec 2022
- 2022Going Beyond XAI: A Systematic Survey for Explanation-Guided Learning7 Dec 2022
- 2022XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Models30 Oct 2022
- 2022Assessing Out-of-Domain Language Model Performance from Few Examples13 Oct 2022
- 2022Fairness via Adversarial Attribute Neighbourhood Robust Learning12 Oct 2022
- 2022Explaining Patterns in Data with Language Models via Interpretable Autoprompting4 Oct 2022
- 2022Augmenting Interpretable Models with LLMs during Training23 Sep 2022
- 2022Domain Classification-based Source-specific Term Penalization for Domain Adaptation in Hate-speech Detection18 Sep 2022
- 2022Shortcut Learning of Large Language Models in Natural Language Understanding25 Aug 2022
- 2022The Birth of Bias: A case study on the evolution of gender bias in an English language model21 Jul 2022
- 2022Fairness and Bias in Robot Learning7 Jul 2022
- 2022VisFIS: Visual Feature Importance Supervision with Right-for-the-Right-Reason Objectives22 Jun 2022
- 2022ER-Test: Evaluating Explanation Regularization Methods for Language Models25 May 2022
- 2022The Unreliability of Explanations in Few-shot Prompting for Textual Reasoning6 May 2022
- 2022Neural Contrastive Clustering: Fully Unsupervised Bias Reduction for Sentiment Classification22 Apr 2022
- 2022A survey on improving NLP models with human explanations19 Apr 2022
- 2022Privileged Attribution Constrained Deep Networks for Facial Expression Recognition24 Mar 2022
- 2022Dynamically Refined Regularization for Improving Cross-corpora Hate Speech Detection23 Mar 2022
- 2022Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvement15 Mar 2022
- 2022FairPrune: Achieving Fairness Through Pruning for Dermatological Disease Diagnosis4 Mar 2022
50 newest of 68 All 68 (JSON)
- 2021EDITS: Modeling and Mitigating Data Bias for Graph Neural Networkscited by 92
- 2022Shortcut Learning of Large Language Models in Natural Language Understandingcited by 83
- 2023Tell Your Model Where to Attend: Post-hoc Attention Steering for LLMscited by 82
- 2023A Survey of Large Language Models Attributioncited by 71
- 2021Fairness via Representation Neutralizationcited by 63
- 2023Explaining black box text modules in natural language with language modelscited by 61
- 2022FairPrune: Achieving Fairness Through Pruning for Dermatological Disease Diagnosiscited by 59
- 2022Beyond Explaining: Opportunities and Challenges of XAI-Based Model Improvementcited by 48
- 2022Contrastive Language-Vision AI Models Pretrained on Web-Scraped Multimodal Data Exhibit Sexual Objectification Biascited by 43
- 2021Shapley Explanation Networkscited by 41
- 2022Augmenting Interpretable Models with LLMs during Trainingcited by 36
- 2021Fast Axiomatic Attribution for Neural Networkscited by 35
12 most cited of 64 All 64 (JSON)
- 2026Steering Neural Network Training through Interpretable Constraints Based on Partial Dependence9 Jul 2026
- 2026ABLE: Representing and Mapping LLMs via Attribution-Based Large-model Embedding20 Apr 2026
- 2025Hybrid Attribution Priors for Explainable and Robust Model Training9 Dec 2025
- 2025Machine Learning from Explanations7 Jul 2025
- 2025Class-Level Feature Selection Method Using Feature Weighted Growing Self-Organising Maps14 Mar 2025
- 2025Large Language Models as Attribution Regularizers for Efficient Model Training27 Feb 2025
- 2025IMPACTX: improving model performance by appropriately constraining the training with teacher explanations17 Feb 2025
- 2025Main Predicate and Their Arguments as Explanation Signals For Intent Classification3 Feb 2025
- 2024Explanation Regularisation through the Lens of Attributions23 Jul 2024
- 2024XEdgeAI: A Human-centered Industrial Inspection Framework with Data-centric Explainable Edge AI Approach16 Jul 2024
- 2024Model Guidance via Explanations Turns Image Classifiers into Segmentation Models3 Jul 2024
- 2024The Impact of an XAI-Augmented Approach on Binary Classification with Scarce Data1 Jul 2024
12 newest of 64 All 64 (JSON)