mlsanityData to 7 Oct 2026

BIMCV-R: A Landmark Dataset for 3D CT Text-Image Retrieval

arXiv 2403.15992 ↗First posted 24 Mar 2024cs.CV cs.CLcited by 28

Not on the map. Why?

Abstract (arXiv)

The burgeoning integration of 3D medical imaging into healthcare has led to a substantial increase in the workload of medical professionals. To assist clinicians in their diagnostic processes and alleviate their workload, the development of a robust system for retrieving similar case studies presents a viable solution. While the concept holds great promise, the field of 3D medical text-image retrieval is currently limited by the absence of robust evaluation benchmarks and curated datasets. To remedy this, our study presents a groundbreaking dataset, BIMCV-R, which includes an extensive collection of 8,069 3D CT volumes, encompassing over 2 million slices, paired with their respective radiological reports. Expanding upon the foundational work of our dataset, we craft a retrieval strategy, MedFinder. This approach employs a dual-stream network architecture, harnessing the potential of large language models to advance the field of medical image retrieval beyond existing text-image retrieval solutions. It marks our preliminary step towards developing a system capable of facilitating text-to-image, image-to-text, and keyword-based retrieval tasks. Our project is available at urlhttps://huggingface.co/datasets/cyd0806/BIMCV-R.

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 20 of its 40 references that are in the map. First posted on arXiv 24 Mar 2024.

Builds on

20 of 40 references.

References · 20

  1. 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
  2. 2021CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrievalcited by 645
  3. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 564
  4. 2023Quilt-1M: One Million Image-Text Pairs for Histopathologycited by 192
  5. 2022LViT: Language meets Vision Transformer in Medical Image Segmentationcited by 110
  6. 2020BIMCV COVID-19+: a large annotated dataset of RX and CT images from COVID-19 patientscited by 81
  7. 2024Large Language Models for Forecasting and Anomaly Detection: A Systematic Literature Reviewcited by 50
  8. 2023Generative Text-Guided 3D Vision-Language Pretraining for Unified Medical Image Segmentationcited by 47
  9. 2023M-FLAG: Medical Vision-Language Pre-training with Frozen Language Models and Latent Space Geometry Optimizationcited by 43
  10. 2022StegaNeRF: Embedding Invisible Information within Neural Radiance Fieldscited by 32
  11. 2024Adaptive Ensembles of Fine-Tuned Transformers for LLM-Generated Text Detectioncited by 22
  12. 2024Particle Filter SLAM for Vehicle Localizationcited by 20
8 more
  1. 2023Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learningcited by 19
  2. 2023Learning Multiscale Consistency for Self-supervised Electron Microscopy Instance Segmentationcited by 16
  3. 2021Hierarchical Deep Network with Uncertainty-aware Semi-supervised Learning for Vessel Segmentationcited by 15
  4. 2023T3D: Advancing 3D Medical Vision-Language Pre-training by Learning Multi-View Visual Consistencycited by 14
  5. 2024News Recommendation with Attention Mechanismcited by 14
  6. 2020Generator Versus Segmentor: Pseudo-healthy Synthesiscited by 12
  7. 20233D-MIR: A Benchmark and Empirical Study on 3D Medical Image Retrieval in Radiologycited by 12
  8. 2024Data-Driven Filter Design in FBP: Transforming CT Reconstruction with Trainable Fourier Seriescited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 10; 2025: 16; 2026: 2.

28 papers.

Sort:

By area:

  1. 2025OFFSET: Segmentation-based Focus Shift Revision for Composed Image Retrievalcited by 40
  2. 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrievalcited by 32
  3. 2024CU-Net: a U-Net architecture for efficient brain-tumor segmentation on BraTS 2019 datasetcited by 24
  4. 2024MSP-MVS: Multi-Granularity Segmentation Prior Guided Multi-View Stereocited by 16
  5. 2024Mask Factory: Towards High-quality Synthetic Data Generation for Dichotomous Image Segmentationcited by 15
  6. 2025CRISP-SAM2: SAM2 with Cross-Modal Interaction and Semantic Prompting for Multi-Organ Segmentationcited by 12
  7. 2024Research on Image Recognition Technology Based on Multimodal Deep Learningcited by 11
  8. 2024DenoMamba: A fused state-space model for low-dose CT denoisingcited by 11
  9. 2024A Survey of Medical Vision-and-Language Applications and Their Techniquescited by 11
  10. 2024DVP-MVS: Synergize Depth-Edge and Visibility Prior for Multi-View Stereocited by 11
  11. 2025SED-MVS: Segmentation-Driven and Edge-Aligned Deformation Multi-View Stereo with Depth Restoration and Occlusion Constraintcited by 10
  12. 2025Taming Vision-Language Models for Medical Image Analysis: A Comprehensive Reviewcited by 9
16 more
  1. 2024Argus: Benchmarking and Enhancing Vision-Language Models for 3D Radiology Report Generationcited by 8
  2. 2024TokenUnify: Scaling Up Autoregressive Pretraining for Neuron Segmentationcited by 7
  3. 2025From large language models to multimodal AI: A scoping review on the potential of generative AI in medicinecited by 5
  4. 2025M3Retrieve: Benchmarking Multimodal Retrieval for Medicinecited by 5
  5. 2025CoC-VLA: Delving into Adversarial Domain Transfer for Explainable Autonomous Driving via Chain-of-Causality Visual-Language-Action Modelcited by 5
  6. 2024UniCompress: Enhancing Multi-Data Medical Image Compression with Knowledge Distillationcited by 2
  7. 2025Rethinking Whole-Body CT Image Interpretation: An Abnormality-Centric Approachcited by 2
  8. 2025M3Ret: Unleashing Zero-shot Multimodal Medical Image Retrieval via Self-Supervisioncited by 2
  9. 2026SigVLP: Sigmoid Volume-Language Pre-Training for Self-Supervised CT-Volume Adaptive Representation Learningcited by 2
  10. 2025HSENet: Hybrid Spatial Encoding Network for 3D Medical Vision-Language Understandingcited by 1
  11. 2025RadiomicsRetrieval: A Customizable Framework for Medical Image Retrieval Using Radiomics Featurescited by 1
  12. 2025Dual form Complementary Masking for Domain-Adaptive Image Segmentationcited by 1
  13. 2025ACM Multimedia Grand Challenge on ENT Endoscopy Analysiscited by 1
  14. 2025INFORM-CT: INtegrating LLMs and VLMs FOR Incidental Findings Management in Abdominal CTcited by 1
  15. 2026A Vision-language Framework for Comparative Reasoning in Radiologycited by 1
  16. 2025brat: Aligned Multi-View Embeddings for Brain MRI Analysiscited by 0