mlsanityData to 14 Oct 2026

Intended Target Identification for Anomia Patients with Gradient-based Selective Augmentation

arXiv 2506.14203 ↗First posted 17 Jun 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

In this study, we investigate the potential of language models (LMs) in aiding patients experiencing anomia, a difficulty identifying the names of items. Identifying the intended target item from patient's circumlocution involves the two challenges of term failure and error: (1) The terms relevant to identifying the item remain unseen. (2) What makes the challenge unique is inherent perturbed terms by semantic paraphasia, which are not exactly related to the target item, hindering the identification process. To address each, we propose robustifying the model from semantically paraphasic errors and enhancing the model with unseen terms with gradient-based selective augmentation. Specifically, the gradient value controls augmented data quality amid semantic errors, while the gradient variance guides the inclusion of unseen but relevant terms. Due to limited domain-specific datasets, we evaluate the model on the Tip-of-the-Tongue dataset as an intermediary task and then apply our findings to real patient data from AphasiaBank. Our results demonstrate strong performance against baselines, aiding anomia patients by addressing the outlined challenges.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 62 references that are in the map. First posted on arXiv 17 Jun 2025.

Builds on

34 of 62 references.

References · 34

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  4. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,605
  5. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,252
  6. 2018Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labelscited by 1,059
  7. 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
  8. 2023Bias and Fairness in Large Language Models: A Surveycited by 639
  9. 2019Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Boundscited by 610
  10. 2018Born Again Neural Networkscited by 546
  11. 2018TextBugger: Generating Adversarial Text Against Real-world Applicationscited by 381
  12. 2019SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimizationcited by 254
22 more
  1. 2021Unsupervised Corpus Aware Language Model Pre-training for Dense Passage Retrievalcited by 203
  2. 2021Condenser: a Pre-training Architecture for Dense Retrievalcited by 162
  3. 2019Revisiting Self-Training for Neural Sequence Generationcited by 155
  4. 2023Hallucinations in Large Multilingual Translation Modelscited by 129
  5. 2020Estimating Example Difficulty Using Variance of Gradientscited by 97
  6. 2020A Simple but Tough-to-Beat Data Augmentation Approach for Natural Language Understanding and Generationcited by 72
  7. 2021Improving Query Representations for Dense Retrieval with Pseudo Relevance Feedbackcited by 47
  8. 2022PRADA: Practical Black-Box Adversarial Attacks against Neural Ranking Modelscited by 44
  9. 2020Gradient-based Analysis of NLP Models is Manipulablecited by 41
  10. 2021HiddenCut: Simple Data Augmentation for Natural Language Understanding with Better Generalizationcited by 32
  11. 2024Prompt Perturbation Consistency Learning for Robust Language Modelscited by 26
  12. 2023Decomposing Complex Queries for Tip-of-the-tongue Retrievalcited by 24
  13. 2021Reweighting Augmented Samples by Minimizing the Maximal Expected Losscited by 21
  14. 2022SimANS: Simple Ambiguous Negatives Sampling for Dense Text Retrievalcited by 21
  15. 2022EPiDA: An Easy Plug-in Data Augmentation Framework for High Performance Text Classificationcited by 7
  16. 2023When the Music Stops: Tip-of-the-Tongue Retrieval for Musiccited by 6
  17. 2021Virtual Data Augmentation: A Robust and General Framework for Fine-tuning Pre-trained Modelscited by 5
  18. 2022When Chosen Wisely, More Data Is What You Need: A Universal Sample-Efficient Strategy For Data Augmentationcited by 5
  19. 2022How does Feedback Signal Quality Impact Effectiveness of Pseudo Relevance Feedback for Passage Retrieval?cited by 5
  20. 2023Careful Whisper -- leveraging advances in automatic speech recognition for robust and interpretable aphasia subtype classificationcited by 5
  21. 2022Collective Relevance Labeling for Passage Retrievalcited by 3
  22. 2023Noisy Self-Training with Synthetic Queries for Dense Retrievalcited by 3

Built on by

Not cited yet.