mlsanityData to 13 Oct 2026

RadHarmony: Radiological Data Handling in the Era of Agentic AI

arXiv 2607.27235 ↗First posted 24 Jul 2026cs.AI cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Training deep learning models on radiological images requires integrating heterogeneous datasets across different sources, file formats, directory layouts, label schemas, and annotation types. We present RadHarmony, an open-source Python library that provides a unified API for loading, harmonizing, and augmenting radiological datasets, with a primary focus on chest radiographs and early support for computed tomography (CT) and magnetic resonance imaging (MRI). RadHarmony standardizes metadata from 24 public datasets into a single tabular format, wraps MONAI's map-style datasets for deep-learning-ready sample delivery with optional on-disk caching, and supports classification labels, segmentation masks, bounding boxes, and radiology report text through a single interface, with an interactive visualization tool for dataset exploration and verification. To lower the barrier for integrating new datasets, RadHarmony introduces an AI-agent skill that guides the full integration workflow from raw data inspection through code generation and testing. We demonstrate the library's utility by pretraining RadHarmony-ViT, a reference vision transformer baseline that combines three heterogeneous chest radiograph datasets with no dataset-specific code. The code and pretrained model weights are available at https://github.com/f10409/RadHarmony.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 18 of its 32 references that are in the map. First posted on arXiv 24 Jul 2026.

Builds on

18 of 32 references.

References · 18

  1. 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,419
  2. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,154
  3. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 970
  4. 2021MedMNIST v2 -- A large-scale lightweight benchmark for 2D and 3D biomedical image classificationcited by 685
  5. 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 593
  6. 2022MONAI: An open-source framework for deep learning in healthcarecited by 443
  7. 2019PadChest: A large chest x-ray image dataset with multi-label annotated reportscited by 309
  8. 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 243
  9. 2020VinDr-CXR: An open dataset of chest X-rays with radiologist's annotationscited by 238
  10. 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 193
  11. 2019Gradio: Hassle-Free Sharing and Testing of ML Models in the Wildcited by 177
  12. 2020TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learningcited by 177
6 more
  1. 2021TorchXRayVision: A library of chest X-ray datasets and modelscited by 131
  2. 2024Exploring scalable medical image encoders beyond text supervisioncited by 130
  3. 2024CheXpert Plus: Augmenting a Large Chest X-ray Dataset with Text Radiology Reports, Patient Demographics and Additional Image Formatscited by 104
  4. 2020Machine-Learning-Based Multiple Abnormality Prediction with Large-Scale Chest Computed Tomography Volumescited by 66
  5. 2025ReXGradient-160K: A Large-Scale Publicly Available Dataset of Chest Radiographs with Free-text Reportscited by 25
  6. 2024The RSNA Abdominal Traumatic Injury CT (RATIC) Datasetcited by 12

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025mAIstro: an open-source multi-agentic system for automated end-to-end development of radiomics and deep learning models for medical imaging
  2. 2026A radiographic world model for clinical reasoning and evidence generation
  3. 2025Medical AI Consensus: A Multi-Agent Framework for Radiology Report Generation and Evaluation
  4. 2026Volumetric Radiology AI in the Era of Multimodal Large Language Models
  5. 2025CBM-RAG: Demonstrating Enhanced Interpretability in Radiology Report Generation with Multi-Agent RAG and Concept Bottleneck Models
  6. 2026RadAgent: A tool-using AI agent for stepwise interpretation of chest computed tomography
  7. 2026RadDiff: Describing Differences in Radiology Image Sets with Natural Language
  8. 2026MARCH: Multi-Agent Radiology Clinical Hierarchy for CT Report Generation