A Diffusion-Driven Fine-Grained Nodule Synthesis Framework for Enhanced Lung Nodule Detection from Chest Radiographs
Not on the map. Why?
Abstract (arXiv)
Early detection of lung cancer in chest radiographs (CXRs) is crucial for improving patient outcomes, yet nodule detection remains challenging due to their subtle appearance and variability in radiological characteristics like size, texture, and boundary. For robust analysis, this diversity must be well represented in training datasets for deep learning based Computer-Assisted Diagnosis (CAD) systems. However, assembling such datasets is costly and often impractical, motivating the need for realistic synthetic data generation. Existing methods lack fine-grained control over synthetic nodule generation, limiting their utility in addressing data scarcity. This paper proposes a novel diffusion-based framework with low-rank adaptation (LoRA) adapters for characteristic controlled nodule synthesis on CXRs. We begin by addressing size and shape control through nodule mask conditioned training of the base diffusion model. To achieve individual characteristic control, we train separate LoRA modules, each dedicated to a specific radiological feature. However, since nodules rarely exhibit isolated characteristics, effective multi-characteristic control requires a balanced integration of features. We address this by leveraging the dynamic composability of LoRAs and revisiting existing merging strategies. Building on this, we identify two key issues, overlapping attention regions and non-orthogonal parameter spaces. To overcome these limitations, we introduce a novel orthogonality loss term during LoRA composition training. Extensive experiments on both in-house and public datasets demonstrate improved downstream nodule detection. Radiologist evaluations confirm the fine-grained controllability of our generated nodules, and across multiple quantitative metrics, our method surpasses existing nodule generation approaches for CXRs.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 45 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
22 of 45 references.
References · 22
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,410
- 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 562
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2022A Survey on Generative Diffusion Modelcited by 238
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
10 more
- 2023ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAscited by 194
- 2023Concept Sliders: LoRA Adaptors for Precise Control in Diffusion Modelscited by 148
- 2024LoRA Soups: Merging LoRAs for Practical Skill Composition Taskscited by 49
- 2025K-LoRA: Unlocking Training-Free Fusion of Any Subject and Style LoRAscited by 48
- 2024LoRA-Switch: Boosting the Efficiency of Dynamic LLM Adapters via System-Algorithm Co-designcited by 18
- 2025Decouple and Orthogonalize: A Data-Free Framework for LoRA Mergingcited by 17
- 2022Image Synthesis with Disentangled Attributes for Chest X-Ray Nodule Augmentation and Detectioncited by 11
- 2024Nodule detection and generation on chest X-rays: NODE21 Challengecited by 7
- 2018Chest X-ray Inpainting with Deep Generative Modelscited by 4
- 2020Extracting and Leveraging Nodule Features with Lung Inpainting for Local Feature Augmentationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Controllable Lung Nodule Synthesis via Histogram-Regularized Latent Diffusion Models
- 2023High-Fidelity Image Synthesis from Pulmonary Nodule Lesion Maps using Semantic Diffusion Model
- 2026DiffusionXRay: A Diffusion and GAN-Based Approach for Enhancing Digitally Reconstructed Chest Radiographs
- 2025LAND: Lung and Nodule Diffusion for 3D Chest CT Synthesis with Anatomical Guidance
- 2026NAMD: Virtual Follow-up Computed Tomography Synthesis via Nodule-Aligned Multimodal Diffusion Models for Early Lung Cancer Diagnosis
- 2026Generation of Chest CT pulmonary Nodule Images by Latent Diffusion Models using the LIDC-IDRI Dataset
- 2026CONFLUX: A Latent Diffusion Model for 3D Chest-CT Synthesis with RL Post-Training
- 2025Curriculum Learning with Synthetic Data for Enhanced Pulmonary Nodule Detection in Chest Radiographs