Learning Variational Word Masks to Improve the Interpretability of Neural Text Classifiers
Not on the map. Why?
Abstract (arXiv)
To build an interpretable neural text classifier, most of the prior work has focused on designing inherently interpretable models or finding faithful explanations. A new line of work on improving model interpretability has just started, and many existing methods require either prior information or human annotations as additional inputs in training. To address this limitation, we propose the variational word mask (VMASK) method to automatically learn task-specific important words and reduce irrelevant information on classification, which ultimately improves the interpretability of model predictions. The proposed method is evaluated with three neural text classifiers (CNN, LSTM, and BERT) on seven benchmark text classification datasets. Experiments show the effectiveness of VMASK in improving both model prediction accuracy and interpretability.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Oct 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 9; 2023: 7; 2024: 6; 2025: 3.
35 papers.
Sort:
By area:
- 2021The Out-of-Distribution Problem in Explainability and Search Methods for Feature Importance Explanationscited by 86
- 2021Towards Improving Adversarial Training of NLP Modelscited by 79
- 2021Improving the Faithfulness of Attention-based Explanations with Task-specific Information for Text Classificationcited by 29
- 2021Interpreting Deep Learning Models in Natural Language Processing: A Reviewcited by 19
- 2021Logic Traps in Evaluating Attribution Scorescited by 18
- 2022Towards Explainable Evaluation Metrics for Natural Language Generationcited by 15
- 2021Explaining Neural Network Predictions on Sentence Pairs via Learning Word-Group Maskscited by 12
- 2022Adversarial Training for Improving Model Robustness? Look at Both Prediction and Interpretationcited by 12
- 2022Unsupervised Text Deidentificationcited by 11
- 2021Flexible Instance-Specific Rationalization of NLP Modelscited by 10
- 2024Normalized AOPC: Fixing Misleading Faithfulness Metrics for Feature Attribution Explainabilitycited by 10
- 2022Human-Centric Research for NLP: Towards a Definition and Guiding Questionscited by 9
23 more
- 2024Towards Faithful Explanations: Boosting Rationalization with Shortcuts Discoverycited by 8
- 2021Local Explanation of Dialogue Response Generationcited by 7
- 2021Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentationcited by 6
- 2022An Information Minimization Based Contrastive Learning Model for Unsupervised Sentence Embeddings Learningcited by 6
- 2023Improving Interpretability via Explicit Word Interaction Graph Layercited by 6
- 2024JoPA:Explaining Large Language Model's Generation via Joint Prompt Attributioncited by 6
- 2022Hierarchical Interpretation of Neural Text Classificationcited by 5
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervisioncited by 5
- 2024Exploring the Trade-off Between Model Performance and Explanation Plausibility of Text Classifiers Using Human Rationalescited by 5
- 2023A Multi-Grained Self-Interpretable Symbolic-Neural Model For Single/Multi-Labeled Text Classificationcited by 4
- 2025Learning Distribution-Wise Control in Representation Space for Language Modelscited by 4
- 2021Explaining the Road Not Takencited by 3
- 2022Pathologies of Pre-trained Language Models in Few-shot Fine-tuningcited by 3
- 2023Consistent Multi-Granular Rationale Extraction for Explainable Multi-hop Fact Verificationcited by 3
- 2022Identifying the Source of Vulnerability in Explanation Discrepancy: A Case Study in Neural Text Classificationcited by 2
- 2023Tell Model Where to Attend: Improving Interpretability of Aspect-Based Sentiment Classification via Small Explanation Annotationscited by 2
- 2025SAFR: Neuron Redistribution for Interpretabilitycited by 2
- 2025Fact in Fragments: Deconstructing Complex Claims via LLM-based Atomic Fact Extraction and Verificationcited by 2
- 2022Interpretable Research Replication Prediction via Variational Contextual Consistency Sentence Maskingcited by 1
- 2024Learning Intrinsic Dimension via Information Bottleneck for Explainable Aspect-based Sentiment Analysiscited by 1
- 2023Unsupervised Text Style Transfer with Deep Generative Modelscited by 0
- 2023CIDR: A Cooperative Integrated Dynamic Refining Method for Minimal Feature Removal Problemcited by 0
- 2024Using Interpretation Methods for Model Enhancementcited by 0
- 2025Fact in Fragments: Deconstructing Complex Claims via LLM-based Atomic Fact Extraction and Verification9 Jun 2025
- 2025Learning Distribution-Wise Control in Representation Space for Language Models7 Jun 2025
- 2025SAFR: Neuron Redistribution for Interpretability23 Jan 2025
- 2024Normalized AOPC: Fixing Misleading Faithfulness Metrics for Feature Attribution Explainability15 Aug 2024
- 2024JoPA:Explaining Large Language Model's Generation via Joint Prompt Attribution30 May 2024
- 2024Exploring the Trade-off Between Model Performance and Explanation Plausibility of Text Classifiers Using Human Rationales3 Apr 2024
- 2024Using Interpretation Methods for Model Enhancement2 Apr 2024
- 2024Towards Faithful Explanations: Boosting Rationalization with Shortcuts Discovery12 Mar 2024
- 2024Learning Intrinsic Dimension via Information Bottleneck for Explainable Aspect-based Sentiment Analysis28 Feb 2024
- 2023CIDR: A Cooperative Integrated Dynamic Refining Method for Minimal Feature Removal Problem13 Dec 2023
- 2023Unsupervised Text Style Transfer with Deep Generative Models31 Aug 2023
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervision23 May 2023
23 more
- 2023Consistent Multi-Granular Rationale Extraction for Explainable Multi-hop Fact Verification16 May 2023
- 2023A Multi-Grained Self-Interpretable Symbolic-Neural Model For Single/Multi-Labeled Text Classification6 Mar 2023
- 2023Tell Model Where to Attend: Improving Interpretability of Aspect-Based Sentiment Classification via Small Explanation Annotations21 Feb 2023
- 2023Improving Interpretability via Explicit Word Interaction Graph Layer3 Feb 2023
- 2022Identifying the Source of Vulnerability in Explanation Discrepancy: A Case Study in Neural Text Classification10 Dec 2022
- 2022Unsupervised Text Deidentification20 Oct 2022
- 2022An Information Minimization Based Contrastive Learning Model for Unsupervised Sentence Embeddings Learning22 Sep 2022
- 2022Human-Centric Research for NLP: Towards a Definition and Guiding Questions10 Jul 2022
- 2022Pathologies of Pre-trained Language Models in Few-shot Fine-tuning17 Apr 2022
- 2022Interpretable Research Replication Prediction via Variational Contextual Consistency Sentence Masking28 Mar 2022
- 2022Adversarial Training for Improving Model Robustness? Look at Both Prediction and Interpretation23 Mar 2022
- 2022Towards Explainable Evaluation Metrics for Natural Language Generation21 Mar 2022
- 2022Hierarchical Interpretation of Neural Text Classification20 Feb 2022
- 2021Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentation10 Dec 2021
- 2021Interpreting Deep Learning Models in Natural Language Processing: A Review20 Oct 2021
- 2021Logic Traps in Evaluating Attribution Scores12 Sep 2021
- 2021Towards Improving Adversarial Training of NLP Models1 Sep 2021
- 2021Local Explanation of Dialogue Response Generation11 Jun 2021
- 2021The Out-of-Distribution Problem in Explainability and Search Methods for Feature Importance Explanations1 Jun 2021
- 2021Improving the Faithfulness of Attention-based Explanations with Task-specific Information for Text Classification6 May 2021
- 2021Flexible Instance-Specific Rationalization of NLP Models16 Apr 2021
- 2021Explaining Neural Network Predictions on Sentence Pairs via Learning Word-Group Masks9 Apr 2021
- 2021Explaining the Road Not Taken27 Mar 2021
- 2021The Out-of-Distribution Problem in Explainability and Search Methods for Feature Importance Explanationscited by 86
- 2021Towards Improving Adversarial Training of NLP Modelscited by 79
- 2021Improving the Faithfulness of Attention-based Explanations with Task-specific Information for Text Classificationcited by 29
- 2021Interpreting Deep Learning Models in Natural Language Processing: A Reviewcited by 19
- 2021Logic Traps in Evaluating Attribution Scorescited by 18
- 2022Towards Explainable Evaluation Metrics for Natural Language Generationcited by 15
- 2021Explaining Neural Network Predictions on Sentence Pairs via Learning Word-Group Maskscited by 12
- 2022Adversarial Training for Improving Model Robustness? Look at Both Prediction and Interpretationcited by 12
- 2022Unsupervised Text Deidentificationcited by 11
- 2021Flexible Instance-Specific Rationalization of NLP Modelscited by 10
- 2024Normalized AOPC: Fixing Misleading Faithfulness Metrics for Feature Attribution Explainabilitycited by 10
- 2022Human-Centric Research for NLP: Towards a Definition and Guiding Questionscited by 9
12 most cited of 34 All 34 (JSON)
- 2025Fact in Fragments: Deconstructing Complex Claims via LLM-based Atomic Fact Extraction and Verification9 Jun 2025
- 2025Learning Distribution-Wise Control in Representation Space for Language Models7 Jun 2025
- 2025SAFR: Neuron Redistribution for Interpretability23 Jan 2025
- 2024Normalized AOPC: Fixing Misleading Faithfulness Metrics for Feature Attribution Explainability15 Aug 2024
- 2024JoPA:Explaining Large Language Model's Generation via Joint Prompt Attribution30 May 2024
- 2024Exploring the Trade-off Between Model Performance and Explanation Plausibility of Text Classifiers Using Human Rationales3 Apr 2024
- 2024Using Interpretation Methods for Model Enhancement2 Apr 2024
- 2024Towards Faithful Explanations: Boosting Rationalization with Shortcuts Discovery12 Mar 2024
- 2024Learning Intrinsic Dimension via Information Bottleneck for Explainable Aspect-based Sentiment Analysis28 Feb 2024
- 2023CIDR: A Cooperative Integrated Dynamic Refining Method for Minimal Feature Removal Problem13 Dec 2023
- 2023Unsupervised Text Style Transfer with Deep Generative Models31 Aug 2023
- 2023Consistent Multi-Granular Rationale Extraction for Explainable Multi-hop Fact Verification16 May 2023
12 newest of 34 All 34 (JSON)