Beyond the Embedding Bottleneck: Adaptive Retrieval-Augmented 3D CT Report Generation
On the map: Retrieval-augmented generation → Medical and biomedical RAG
Abstract (arXiv)
Automated radiology report generation from 3D CT volumes often suffers from incomplete pathology coverage. We provide empirical evidence that this limitation stems from a representational bottleneck: contrastive 3D CT embeddings encode discriminative pathology signals, yet exhibit severe dimensional concentration, with as few as 2 effective dimensions out of 512. Corroborating this, scaling the language model yields no measurable improvement, suggesting that the bottleneck lies in the visual representation rather than the generator. This bottleneck limits both generation and retrieval; naive static retrieval fails to improve clinical efficacy and can even degrade performance. We propose AdaRAG-CT, an adaptive augmentation framework that compensates for this visual bottleneck by introducing supplementary textual information through controlled retrieval and selectively integrating it during generation. On the CT-RATE benchmark, AdaRAG-CT achieves state-of-the-art clinical efficacy, improving Clinical F1 from 0.420 (CT-Agent) to 0.480 (+6 points); ablation studies confirm that both the retrieval and generation components contribute to the improvement. Code is available at https://github.com/renjie-liang/Adaptive-RAG-for-3DCT-Report-Generation.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Medical and biomedical RAG, one of 15 directions in Retrieval-augmented generation. Builds on 36 of its 48 references that are in the map. First posted on arXiv 16 Mar 2026.
Builds on
36 of 48 references.
Closest ancestors · 1
Same direction, newest first
Other references · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Visual Instruction Tuningcited by 7,792
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2016Understanding intermediate layers using linear classifier probescited by 1,279
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 658
- 2022Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learningcited by 553
- 2023Active Retrieval Augmented Generationcited by 506
- 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 374
23 more
- 2020Generating Radiology Reports via Memory-driven Transformercited by 363
- 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 336
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 192
- 2023Towards Generalist Foundation Model for Radiology by Leveraging Web-scale 2D&3D Medical Datacited by 176
- 2024M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Modelscited by 154
- 2023METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokenscited by 98
- 2024CT2Rep: Automated Radiology Report Generation for 3D Medical Imagingcited by 96
- 2025Large-scale and Fine-grained Vision-language Pre-training for Enhanced CT Image Understandingcited by 53
- 2025Med3DVLM: An Efficient Vision-Language Model for 3D Medical Image Analysiscited by 44
- 2023Panoptic Scene Graph Generation with Semantics-Prototype Learningcited by 42
- 2025Treble Counterfactual VLMs: A Causal Approach to Hallucinationcited by 33
- 2024VividMed: Vision Language Model with Versatile Visual Grounding for Medicinecited by 28
- 2024DPU: Dynamic Prototype Updating for Multimodal Out-of-Distribution Detectioncited by 28
- 2025CT-Agent: A Multimodal-LLM Agent for 3D CT Radiology Question Answeringcited by 20
- 2025Better Tokens for Better 3D: Advancing Vision-Language Modeling in 3D Medical Imagingcited by 20
- 2025Secure On-Device Video OOD Detection Without Backpropagationcited by 19
- 2024Read Like a Radiologist: Efficient Vision-Language Model for 3D Medical Imaging Interpretationcited by 18
- 2025A Personalized Conversational Benchmark: Towards Simulating Personalized Conversationscited by 16
- 2025Boosting Vision Semantic Density with Anatomy Normality Modeling for Medical Vision-language Pre-trainingcited by 14
- 2026Defenses Against Prompt Attacks Learn Surface Heuristicscited by 10
- 2024Learning the Unlearned: Mitigating Feature Suppression in Contrastive Learningcited by 9
- 2025Charts Are Not Images: On the Challenges of Scientific Chart Editingcited by 9
- 2025A Clinically-Grounded Two-Stage Framework for Renal CT Report Generationcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Generating Reports or Repeating Templates? Measuring and Mitigating Template Collapse in 3D CT Report Generation
- 2026Retrieval-Augmented Anatomical Guidance for Text-to-CT Generation
- 2025Radiology Report Conditional 3D CT Generation with Multi Encoder Latent diffusion Model
- 2024Argus: Benchmarking and Enhancing Vision-Language Models for 3D Radiology Report Generation
- 2026Learning to Read Where to Look: Disease-Aware Vision-Language Pretraining for 3D CT
- 2026Curriculum-Driven 3D CT Report Generation via Language-Free Visual Grafting and Zone-Constrained Compression
- 2026Revisiting LLM Adaptation for 3D CT Report Generation: A Study of Scaling and Diagnostic Priors
- 2025Exploring the Design Space of 3D MLLMs for CT Report Generation