mlsanityData to 14 Oct 2026

GateSPINE: Gated Cross-View Fusion for Lumbar Spine MRI Report Generation

arXiv 2609.40091 ↗First posted 30 Sep 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Automated report generation can ease the burden radiolo gists face when interpreting multi-sequence MRI studies. Unlike CT, MRI examinations comprise multiple sequences and imaging planes, each con tributing complementary diagnostic information. Existing methods en code a study as a single volume and combine multiple acquisitions by fixed rules. Findings visible in only one plane are thus diluted and of ten missed, lowering recall on clinical efficacy metrics, where a missed abnormality is most costly. We propose GateSPINE, a vision-language framework that fuses sagittal T1 and T2 volumes with a training-free operator, encodes the fused sagittal and axial volumes with two parallel 3D encoders, and decodes their combined representation into a report. Its core mechanism is a gated cross view fusion module that predicts, per feature channel and token, how much of each view to admit, so the more informative view dominates at each spatial location. We evaluate GateSPINE on three lumbar MRI datasets, comprising two public bench marks and a private cohort collected from Phenikaa University Hospital, using both natural language generation (NLG) and clinical efficacy (CE) metrics. GateSPINE achieves the highest CE F1 through improved re call on all three datasets; on SPIDER, which lacks an axial sequence, this reflects the sagittal fusion component rather than the gated cross-view mechanism, which is validated on the two cohorts with both imaging planes. GateSPINE also remains competitive on standard NLG metrics.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 25 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

15 of 25 references.

References · 15

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  4. 2025MedGemma Technical Reportcited by 436
  5. 2017Gated Multimodal Units for Information Fusioncited by 248
  6. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
  7. 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 162
  8. 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
  9. 2025Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysiscited by 46
  10. 2024Dia-LLaMA: Towards Large Language Model-driven CT Report Generationcited by 32
  11. 2023Lumbar spine segmentation in MR images: a dataset and a public benchmarkcited by 30
  12. 2024Large Language Model with Region-guided Referring and Grounding for CT Report Generationcited by 28
3 more
  1. 2024Test-Time Dynamic Image Fusioncited by 6
  2. 2026PhenSPINE: A Standardized Benchmark for Spine Pathology Diagnosiscited by 1
  3. 2026CrossSpine: Multi-scale Cross-sequence Attention with Anatomical Priors for Automated Pfirrmann Gradingcited by 1

Built on by

Not cited yet.