mlsanityData to 14 Oct 2026

FocusMed: A Large Language Model-based Framework for Enhancing Medical Question Summarization with Focus Identification

arXiv 2510.04671 ↗First posted 6 Oct 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

With the rapid development of online medical platforms, consumer health questions (CHQs) are inefficient in diagnosis due to redundant information and frequent non-professional terms. The medical question summary (MQS) task aims to transform CHQs into streamlined doctors' frequently asked questions (FAQs), but existing methods still face challenges such as poor identification of question focus and model hallucination. This paper explores the potential of large language models (LLMs) in the MQS task and finds that direct fine-tuning is prone to focus identification bias and generates unfaithful content. To this end, we propose an optimization framework based on core focus guidance. First, a prompt template is designed to drive the LLMs to extract the core focus from the CHQs that is faithful to the original text. Then, a fine-tuning dataset is constructed in combination with the original CHQ-FAQ pairs to improve the ability to identify the focus of the question. Finally, a multi-dimensional quality evaluation and selection mechanism is proposed to comprehensively improve the quality of the summary from multiple dimensions. We conduct comprehensive experiments on two widely-adopted MQS datasets using three established evaluation metrics. The proposed framework achieves state-of-the-art performance across all measures, demonstrating a significant boost in the model's ability to identify critical focus of questions and a notable mitigation of hallucinations. The source codes are freely available at https://github.com/DUT-LiuChao/FocusMed.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 35 references that are in the map. First posted on arXiv 6 Oct 2025.

Builds on

23 of 35 references.

References · 23

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  6. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  7. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  8. 2024Qwen2 Technical Reportcited by 2,120
  9. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 638
  10. 2019Text Summarization with Pretrained Encoderscited by 556
  11. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
  12. 2023Med-HALT: Medical Domain Hallucination Test for Large Language Modelscited by 157
11 more
  1. 2023Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Taskscited by 36
  2. 2021Reinforcement Learning for Abstractive Question Summarization with Question-aware Semantic Rewardscited by 22
  3. 2023DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generationcited by 16
  4. 2024Towards Reliable Medical Question Answering: Techniques and Challenges in Mitigating Hallucinations in Language Modelscited by 15
  5. 2024MedHallBench: A New Benchmark for Assessing Hallucination in Medical Large Language Modelscited by 15
  6. 2024Enhancing Healthcare through Large Language Models: A Study on Medical Question Answeringcited by 14
  7. 2023Large Knowledge Model: Perspectives and Challengescited by 12
  8. 2023FaMeSumm: Investigating and Improving Faithfulness of Medical Summarizationcited by 9
  9. 2024Fine Tuning Large Language Models for Medicine: The Role and Importance of Direct Preference Optimizationcited by 6
  10. 2022Focus-Driven Contrastive Learniang for Medical Question Summarizationcited by 5
  11. 2023Medical Question Summarization with Entity-driven Contrastive Learningcited by 5

Built on by

Not cited yet.