mlsanityData to 14 Oct 2026

LIMITR: Leveraging Local Information for Medical Image-Text Representation

arXiv 2303.11755 ↗First posted 21 Mar 2023cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

Medical imaging analysis plays a critical role in the diagnosis and treatment of various medical conditions. This paper focuses on chest X-ray images and their corresponding radiological reports. It presents a new model that learns a joint X-ray image & report representation. The model is based on a novel alignment scheme between the visual data and the text, which takes into account both local and global information. Furthermore, the model integrates domain-specific information of two types -- lateral images and the consistent visual structure of chest images. Our representation is shown to benefit three types of retrieval tasks: text-image retrieval, class-based retrieval, and phrase-grounding.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 20 of its 29 references that are in the map. First posted on arXiv 21 Mar 2023.

Builds on

20 of 29 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
  6. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,214
  7. 2019Publicly Available Clinical BERT Embeddingscited by 1,002
  8. 2014Deep Visual-Semantic Alignments for Generating Image Descriptionscited by 968
  9. 2020Contrastive Learning of Medical Visual Representations from Paired Images and Textcited by 641
  10. 2022MedCLIP: Contrastive Learning from Unpaired Medical Images and Textcited by 570
  11. 2018Stacked Cross Attention for Image-Text Matchingcited by 416
  12. 2022Making the Most of Text Semantics to Improve Biomedical Vision--Language Processingcited by 339
8 more
  1. 2020COVID-Net: A Tailored Deep Convolutional Neural Network Design for Detection of COVID-19 Cases from Chest X-Ray Imagescited by 264
  2. 2019Visual Semantic Reasoning for Image-Text Matchingcited by 185
  3. 2022A Survey of Vision-Language Pre-Trained Modelscited by 177
  4. 2022Multi-Granularity Cross-modal Alignment for Generalized Medical Visual Representation Learningcited by 159
  5. 2021Similarity Reasoning and Filtration for Image-Text Matchingcited by 121
  6. 2021Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Trainingcited by 96
  7. 2021Joint Learning of Localized Representations from Medical Images and Reportscited by 81
  8. 2017Learning Semantic Concepts and Order for Image and Sentence Matchingcited by 62

Built on by

Cited by year

Citing papers per year: 2023: 3; 2024: 8; 2025: 2.

13 papers.

Sort:

By area:

  1. 2024Improving fine-grained understanding in image-text pre-trainingcited by 44
  2. 2024Cross-Modal Conditioned Reconstruction for Language-guided Medical Image Segmentationcited by 28
  3. 2023Fine-Grained Image-Text Alignment in Medical Imaging Enables Explainable Cyclic Image-Report Generationcited by 26
  4. 2023Medical Vision Language Pretraining: A surveycited by 24
  5. 2024HyperFusion: A Hypernetwork Approach to Multimodal Integration of Tabular and Medical Imaging Data for Predictive Modelingcited by 15
  6. 2024Unlocking the Power of Spatial and Temporal Information in Medical Multimodal Pre-trainingcited by 13
  7. 2024MedRAT: Unpaired Medical Report Generation via Auxiliary Taskscited by 9
  8. 2024Zero-Shot Medical Phrase Grounding with Off-the-shelf Diffusion Modelscited by 7
  9. 2023Masked Contrastive Reconstruction for Cross-modal Medical Image-Report Retrievalcited by 6
  10. 2024Image-aware Evaluation of Generated Medical Reportscited by 3
  11. 2024MedCycle: Unpaired Medical Report Generation via Cycle-Consistencycited by 2
  12. 2025Alignment, Mining and Fusion: Representation Alignment with Hard Negative Mining and Selective Knowledge Fusion for Medical Visual Question Answeringcited by 1
1 more
  1. 2025Anatomy-Aware Conditional Image-Text Retrievalcited by 0