A survey on improving NLP models with human explanations
Not on the map. Why?
Abstract (arXiv)
Training a model with access to human explanations can improve data efficiency and model performance on in- and out-of-domain data. Adding to these empirical findings, similarity with the process of human learning makes learning from explanations a promising way to establish a fruitful human-machine interaction. Several methods have been proposed for improving natural language processing (NLP) models with human explanations, that rely on different explanation types and mechanism for integrating these explanations into the learning process. These methods are rarely compared with each other, making it hard for practitioners to choose the best combination of explanation type and integration mechanism for a specific use-case. In this paper, we give an overview of different methods for learning from human explanations, and discuss different factors that can inform the decision of which method to choose for a specific use-case.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 33 of its 51 references that are in the map. First posted on arXiv 19 Apr 2022.
Builds on
33 of 51 references.
References · 33
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2018e-SNLI: Natural Language Inference with Natural Language Explanationscited by 468
- 2020HateXplain: A Benchmark Dataset for Explainable Hate Speech Detectioncited by 403
- 2019Explain Yourself! Leveraging Language Models for Commonsense Reasoningcited by 367
- 2019Mitigating Gender Bias in Natural Language Processing: Literature Reviewcited by 287
- 2016Rationalizing Neural Predictionscited by 281
- 2016Data Programming: Creating Large Training Sets, Quicklycited by 246
- 2020Measuring Association Between Labels and Free-Text Rationalescited by 159
- 2020A Diagnostic Study of Explainability Techniques for Text Classificationcited by 158
- 2019Interpretations are useful: penalizing explanations to align neural networks with prior knowledgecited by 144
- 2021Teach Me to Explain: A Review of Datasets for Explainable Natural Language Processingcited by 126
- 2019Rethinking Cooperative Rationalization: Introspective Extraction and Complement Controlcited by 96
21 more
- 2020NILE : Natural Language Inference with Faithful Natural Language Explanationscited by 96
- 2020Evaluating Explanations: How much do explanations from the teacher aid students?cited by 94
- 2020Aligning Faithful Interpretations with their Social Attributioncited by 79
- 2021When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Datacited by 75
- 2019Incorporating Priors with Feature Attribution on Text Classificationcited by 68
- 2018Training Classifiers with Natural Language Explanationscited by 58
- 2018Deriving Machine Attention from Human Rationalescited by 54
- 2021Explanation-Based Human Debugging of NLP Models: A Surveycited by 53
- 2016Rationale-Augmented Convolutional Neural Networks for Text Classificationcited by 39
- 2020Evaluating and Characterizing Human Rationalescited by 36
- 2019Do Human Rationales Improve Machine Explanations?cited by 33
- 2021On the Diversity and Limits of Human Explanationscited by 30
- 2020ExpBERT: Representation Engineering with Natural Language Explanationscited by 28
- 2021Refining Language Models with Compositional Explanationscited by 27
- 2021What to Learn, and How: Toward Effective Learning from Rationalescited by 25
- 2020LIREx: Augmenting Language Inference with Relevant Explanationcited by 24
- 2019Fine-grained Sentiment Analysis with Faithful Attentioncited by 23
- 2020Teaching Machine Comprehension with Compositional Explanationscited by 22
- 2019Learning from Explanations with Neural Execution Treecited by 18
- 2020LEAN-LIFE: A Label-Efficient Annotation Framework Towards Learning from Explanationcited by 11
- 2020Interacting with Explanations through Critiquingcited by 9
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 4; 2025: 4; 2026: 1.
15 papers.
Sort:
By area:
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
- 2023Explain-then-Translate: An Analysis on Improving Program Translation with Self-generated Explanationscited by 12
- 2022XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Modelscited by 8
- 2022Mediators: Conversational Agents Explaining NLP Model Behaviorcited by 7
- 2022ER-Test: Evaluating Explanation Regularization Methods for Language Modelscited by 6
- 2024Human-LLM Hybrid Text Answer Aggregation for Crowd Annotationscited by 4
- 2024EXCGEC: A Benchmark for Edit-Wise Explainable Chinese Grammatical Error Correctioncited by 1
- 2024Explanation Regularisation through the Lens of Attributionscited by 1
- 2025Learning from Sufficient Rationales: Analysing the Relationship Between Explanation Faithfulness and Token-level Regularisation Strategiescited by 1
- 2026Disagreeing Rationales: Rethinking Classification and Explainability Evaluation in Hate Speech Detectioncited by 1
- 2023Teach Me How to Improve My Argumentation Skills: A Survey on Feedback in Argumentationcited by 0
3 more
- 2025Emerging categories in scientific explanationscited by 0
- 2025Decoding the Multimodal Maze: A Systematic Review on the Adoption of Explainability in Multimodal Attention-based Modelscited by 0
- 2025Can LLM-Generated Textual Explanations Enhance Model Classification Performance? An Empirical Studycited by 0
- 2026Disagreeing Rationales: Rethinking Classification and Explainability Evaluation in Hate Speech Detection29 May 2026
- 2025Learning from Sufficient Rationales: Analysing the Relationship Between Explanation Faithfulness and Token-level Regularisation Strategies20 Nov 2025
- 2025Can LLM-Generated Textual Explanations Enhance Model Classification Performance? An Empirical Study13 Aug 2025
- 2025Decoding the Multimodal Maze: A Systematic Review on the Adoption of Explainability in Multimodal Attention-based Models6 Aug 2025
- 2025Emerging categories in scientific explanations23 May 2025
- 2024Human-LLM Hybrid Text Answer Aggregation for Crowd Annotations22 Oct 2024
- 2024Explanation Regularisation through the Lens of Attributions23 Jul 2024
- 2024EXCGEC: A Benchmark for Edit-Wise Explainable Chinese Grammatical Error Correction1 Jul 2024
- 2024Demystifying Chains, Trees, and Graphs of Thoughts25 Jan 2024
- 2023Explain-then-Translate: An Analysis on Improving Program Translation with Self-generated Explanations13 Nov 2023
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Models18 Aug 2023
- 2023Teach Me How to Improve My Argumentation Skills: A Survey on Feedback in Argumentation28 Jul 2023
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
- 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
- 2022XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Modelscited by 8
- 2022Mediators: Conversational Agents Explaining NLP Model Behaviorcited by 7
- 2022ER-Test: Evaluating Explanation Regularization Methods for Language Modelscited by 6
- 2024Human-LLM Hybrid Text Answer Aggregation for Crowd Annotationscited by 4
- 2024EXCGEC: A Benchmark for Edit-Wise Explainable Chinese Grammatical Error Correctioncited by 1
- 2024Explanation Regularisation through the Lens of Attributionscited by 1
- 2025Learning from Sufficient Rationales: Analysing the Relationship Between Explanation Faithfulness and Token-level Regularisation Strategiescited by 1
- 2026Disagreeing Rationales: Rethinking Classification and Explainability Evaluation in Hate Speech Detectioncited by 1
- 2023Teach Me How to Improve My Argumentation Skills: A Survey on Feedback in Argumentationcited by 0
- 2025Emerging categories in scientific explanationscited by 0
- 2025Decoding the Multimodal Maze: A Systematic Review on the Adoption of Explainability in Multimodal Attention-based Modelscited by 0
- 2025Can LLM-Generated Textual Explanations Enhance Model Classification Performance? An Empirical Studycited by 0
- 2026Disagreeing Rationales: Rethinking Classification and Explainability Evaluation in Hate Speech Detection29 May 2026
- 2025Learning from Sufficient Rationales: Analysing the Relationship Between Explanation Faithfulness and Token-level Regularisation Strategies20 Nov 2025
- 2025Can LLM-Generated Textual Explanations Enhance Model Classification Performance? An Empirical Study13 Aug 2025
- 2025Decoding the Multimodal Maze: A Systematic Review on the Adoption of Explainability in Multimodal Attention-based Models6 Aug 2025
- 2025Emerging categories in scientific explanations23 May 2025
- 2024Human-LLM Hybrid Text Answer Aggregation for Crowd Annotations22 Oct 2024
- 2024Explanation Regularisation through the Lens of Attributions23 Jul 2024
- 2024EXCGEC: A Benchmark for Edit-Wise Explainable Chinese Grammatical Error Correction1 Jul 2024
- 2023Teach Me How to Improve My Argumentation Skills: A Survey on Feedback in Argumentation28 Jul 2023
- 2022XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Models30 Oct 2022
- 2022Mediators: Conversational Agents Explaining NLP Model Behavior13 Jun 2022
- 2022ER-Test: Evaluating Explanation Regularization Methods for Language Models25 May 2022