mlsanityData to 7 Oct 2026

Prior-RadGraphFormer: A Prior-Knowledge-Enhanced Transformer for Generating Radiology Graphs from X-Rays

arXiv 2303.13818 ↗First posted 24 Mar 2023cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

The extraction of structured clinical information from free-text radiology reports in the form of radiology graphs has been demonstrated to be a valuable approach for evaluating the clinical correctness of report-generation methods. However, the direct generation of radiology graphs from chest X-ray (CXR) images has not been attempted. To address this gap, we propose a novel approach called Prior-RadGraphFormer that utilizes a transformer model with prior knowledge in the form of a probabilistic knowledge graph (PKG) to generate radiology graphs directly from CXR images. The PKG models the statistical relationship between radiology entities, including anatomical structures and medical observations. This additional contextual information enhances the accuracy of entity and relation extraction. The generated radiology graphs can be applied to various downstream tasks, such as free-text or structured reports generation and multi-label classification of pathologies. Our approach represents a promising method for generating radiology graphs directly from CXR images, and has significant potential for improving medical image analysis and clinical decision-making.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 24 Mar 2023.

Builds on

20 of 33 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020End-to-End Object Detection with Transformerscited by 7,384
  3. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
  4. 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 590
  5. 2019Graph Transformer Networkscited by 520
  6. 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 413
  7. 2016Visual Relationship Detection with Language Priorscited by 333
  8. 2021RadGraph: Extracting Clinical Entities and Relations from Radiology Reportscited by 310
  9. 2015A Review of Relational Machine Learning for Knowledge Graphscited by 264
  10. 2018TieNet: Text-Image Embedding Network for Common Thorax Disease Classification and Reporting in Chest X-rayscited by 139
  11. 2021SGTR: End-to-end Scene Graph Generation with Transformercited by 102
  12. 2020Convolutional Networks with Dense Connectivitycited by 98
8 more
  1. 2021Chest ImaGenome Dataset for Clinical Reasoningcited by 89
  2. 2020Deep Graph Matching via Blackbox Differentiation of Combinatorial Solverscited by 81
  3. 2022Relationformer: A Unified Framework for Image-to-Graph Generationcited by 67
  4. 2016Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotationcited by 59
  5. 2019Metrics for Graph Comparison: A Practitioner's Guidecited by 37
  6. 2021RATCHET: Medical Transformer for Chest X-ray Diagnosis and Reportingcited by 34
  7. 2020Classification by Attention: Scene Graph Classification with Prior Knowledgecited by 26
  8. 2018Improving Information Extraction from Images with Learned Semantic Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025HASD: Hierarchical Adaption for pathology Slide-level Domain-shiftcited by 6
  2. 2026Beyond Masks: The Case for Medical Image Parsingcited by 0