mlsanityData to 7 Oct 2026

Generating Completions for Broca's Aphasic Sentences Using Large Language Models

arXiv 2412.17669 ↗First posted 23 Dec 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Broca's aphasia is a type of aphasia characterized by non-fluent, effortful and agrammatic speech production with relatively good comprehension. Since traditional aphasia treatment methods are often time-consuming, labour-intensive, and do not reflect real-world conversations, applying natural language processing based approaches such as Large Language Models (LLMs) could potentially contribute to improving existing treatment approaches. To address this issue, we explore the use of sequence-to-sequence LLMs for completing Broca's aphasic sentences. We first generate synthetic Broca's aphasic data using a rule-based system designed to mirror the linguistic characteristics of Broca's aphasic speech. Using this synthetic data (without authentic aphasic samples), we then fine-tune four pre-trained LLMs on the task of completing agrammatic sentences. We evaluate our fine-tuned models on both synthetic and authentic Broca's aphasic data. We demonstrate LLMs' capability for reconstructing agrammatic sentences, with the models showing improved performance with longer input utterances. Our result highlights the LLMs' potential in advancing communication aids for individuals with Broca's aphasia and possibly other clinical populations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 55 references that are in the map. First posted on arXiv 23 Dec 2024.

Builds on

13 of 55 references.

References · 13

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  6. 2021Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Modelscited by 462
  7. 2023Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluationcited by 134
  8. 2021Understanding by Understanding Not: Modeling Negation in Language Modelscited by 73
  9. 2019Towards Automatic Generation of Shareable Synthetic Clinical Notes Using Neural Language Modelscited by 20
  10. 2024Predicting Machine Translation Performance on Low-Resource Languages: The Role of Domain Similaritycited by 15
  11. 2024Paraphrasing in Affirmative Terms Improves Negation Understandingcited by 7
  12. 2023Seq2seq for Automatic Paraphasia Detection in Aphasic Speechcited by 4
1 more
  1. 2024Detecting Post-Stroke Aphasia Via Brain Responses to Speech in a Deep Learning Frameworkcited by 1

Built on by

Not cited yet.