Semantic-Topological Graph Reasoning for Language-Guided Pulmonary Screening
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Medical image segmentation driven by free-text clinical instructions is a critical frontier in computer-aided diagnosis. However, existing multimodal and foundation models struggle with the semantic ambiguity of clinical reports and fail to disambiguate complex anatomical overlaps in low-contrast scans. Furthermore, fully fine-tuning these massive architectures on limited medical datasets invariably leads to severe overfitting. To address these challenges, we propose a novel Semantic-Topological Graph Reasoning (STGR) framework for language-guided pulmonary screening. Our approach elegantly synergizes the reasoning capabilities of large language models (LLaMA-3-V) with the zero-shot delineation of vision foundation models (MedSAM). Specifically, we introduce a Text-to-Vision Intent Distillation (TVID) module to extract precise diagnostic guidance. To resolve anatomical ambiguity, we formulate mask selection as a dynamic graph reasoning problem, where candidate lesions are modeled as nodes and edges capture spatial and semantic affinities. To ensure deployment feasibility, we introduce a Selective Asymmetric Fine-Tuning (SAFT) strategy that updates less than 1% of the parameters. Rigorous 5-fold cross-validation on the LIDC-IDRI and LNDb datasets demonstrates that our framework establishes a new state-of-the-art. Notably, it achieves an 81.5% Dice Similarity Coefficient (DSC) on LIDC-IDRI, outperforming leading LLM-based tools like LISA by over 5%. Crucially, our SAFT strategy acts as a powerful regularizer, yielding exceptional cross-fold stability (0.6% DSC variance) and paving the way for robust, context-aware clinical deployment.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 15 of its 23 references that are in the map. First posted on arXiv 7 Apr 2026.
Builds on
15 of 23 references.
Closest ancestors · 1
Same direction, newest first
Other references · 14
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
- 2023Segment Everything Everywhere All at Oncecited by 546
- 2019LNDb: A Lung Nodule Database on Computed Tomographycited by 27
- 2025DeepGB-TB: A Risk-Balanced Cross-Attention Gradient-Boosted Convolutional Network for Rapid, Interpretable Tuberculosis Screeningcited by 6
- 2026SkinCLIP-VL: Consistency-Aware Vision-Language Learning for Multimodal Skin Cancer Diagnosiscited by 3
- 2025PRISM: A Personality-Driven Multi-Agent Framework for Social Media Simulationcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Visual Cues: CoT-Enhanced Reasoning for Semi-supervised Medical Image Segmentation
- 2026SAM Meets VLM: Parameter-Decoupled Full-Parameter Training for Unified Medical Reasoning and Segmentation
- 2026Lung-R1: A Knowledge Graph-Guided LLM for Pulmonary Diagnostic Reasoning
- 2025Adapting Foundation Vision-Language Models to Medical Diagnosis via Query-Driven Expert Bridging
- 2026Segmentation, Detection and Explanation: A Unified Framework for CT Appearance Reasoning
- 2026M3CoTBench: Benchmark Chain-of-Thought of MLLMs in Medical Image Understanding
- 2026Structural Graph Neural Networks with Anatomical Priors for Explainable Chest X-ray Diagnosis
- 2025Vision-Language Model-Based Semantic-Guided Imaging Biomarker for Lung Nodule Malignancy Prediction