mlsanityData to 7 Oct 2026

An Explainable Vision-Language Model Framework with Adaptive PID-Tversky Loss for Lumbar Spinal Stenosis Diagnosis

arXiv 2604.02502 ↗First posted 2 Apr 2026cs.CV cs.AIcited by 1

On the map: Multimodal LLMs / vision-language models → Medical vision-language models

Abstract (arXiv)

Lumbar Spinal Stenosis (LSS) diagnosis remains a critical clinical challenge, with diagnosis heavily dependent on labor-intensive manual interpretation of multi-view Magnetic Resonance Imaging (MRI), leading to substantial inter-observer variability and diagnostic delays. Existing vision-language models simultaneously fail to address the extreme class imbalance prevalent in clinical segmentation datasets while preserving spatial accuracy, primarily due to global pooling mechanisms that discard crucial anatomical hierarchies. We present an end-to-end Explainable Vision-Language Model framework designed to overcome these limitations, achieved through two principal objectives. We propose a Spatial Patch Cross-Attention module that enables precise, text-directed localization of spinal anomalies with spatial precision. A novel Adaptive PID-Tversky Loss function by integrating control theory principles dynamically further modifies training penalties to specifically address difficult, under-segmented minority instances. By incorporating foundational VLMs alongside an Automated Radiology Report Generation module, our framework demonstrates considerable performance: a diagnostic classification accuracy of 90.69%, a macro-averaged Dice score of 0.9512 for segmentation, and a CIDEr score of 92.80%. Furthermore, the framework shows explainability by converting complex segmentation predictions into radiologist-style clinical reports, thereby establishing a new benchmark for transparent, interpretable AI in clinical medical imaging that keeps essential human supervision while enhancing diagnostic capabilities.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Medical vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 11 of its 40 references that are in the map. First posted on arXiv 2 Apr 2026.

Builds on

11 of 40 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Day1 Jun

Other references · 10

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
  3. 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
  4. 2017Tversky loss function for image segmentation using 3D fully convolutional deep networkscited by 228
  5. 2019CE-Net: Context Encoder Network for 2D Medical Image Segmentationcited by 219
  6. 2018A Novel Focal Tversky loss function with improved Attention U-Net for lesion segmentationcited by 171
  7. 2021Vision Transformers with Hierarchical Attentioncited by 31
  8. 2020Pay Attention to Evolution: Time Series Forecasting with Deep Graph-Evolution Learningcited by 22
  9. 2025M-SCAN: A Multistage Framework for Lumbar Spinal Canal Stenosis Grading Using Multi-View Cross Attentioncited by 2
  10. 2025FoundationalECGNet: A Lightweight Foundational Model for ECG-based Multitask Cardiac Analysiscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Fluency: A Clinical Benchmark and Anomaly-Enhanced Baseline for Spine MRI Report Generation
  2. 2025SpineBench: Benchmarking Multimodal LLMs for Spinal Pathology Analysis
  3. 2025SpinalSAM-R1: A Vision-Language Multimodal Interactive System for Spine CT Segmentation
  4. 2024SpineMamba: Enhancing 3D Spinal Segmentation in Clinical Imaging through Residual Visual Mamba Layers and Shape Priors
  5. 2024ContourDiff: Unpaired Medical Image Translation with Structural Consistency
  6. 2024Diffusion-Based Semantic Segmentation of Lumbar Spine MRI Scans of Lower Back Pain Patients
  7. 2026Enhancing Low Back Pain Assessment with Diffusion Models for Lumbar Spine MRI Segmentation
  8. 2023Introducing Shape Prior Module in Diffusion Model for Medical Image Segmentation