Structure-Guided Histopathology Synthesis via Dual-LoRA Diffusion
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
Histopathology image synthesis plays an important role in tissue restoration, data augmentation, and modeling of tumor microenvironments. However, existing generative methods typically address restoration and generation as separate tasks, although both share the same objective of structure-consistent tissue synthesis under varying degrees of missingness, and often rely on weak or inconsistent structural priors that limit realistic cellular organization. We propose Dual-LoRA Controllable Diffusion, a unified centroid-guided diffusion framework that jointly supports Local Structure Completion and Global Structure Synthesis within a single model. Multi-class nuclei centroids serve as lightweight and annotation-efficient spatial priors, providing biologically meaningful guidance under both partial and complete image absence. Two task-specific LoRA adapters specialize the shared backbone for local and global objectives without retraining separate diffusion models. Extensive experiments demonstrate consistent improvements over state-of-the-art GAN and diffusion baselines across restoration and synthesis tasks. For local completion, LPIPS computed within the masked region improves from 0.1797 (HARP) to 0.1524, and for global synthesis, FID improves from 225.15 (CoSys) to 76.04, indicating improved structural fidelity and realism. Our approach achieves more faithful structural recovery in masked regions and substantially improved realism and morphology consistency in full synthesis, supporting scalable pan-cancer histopathology modeling.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 14 of its 26 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
14 of 26 references.
Closest ancestors · 3
Same direction, newest first
- 2024TopoCellGen: Generating Histopathology Cell Topology with a Diffusion Model8 Dec
- 2024ZoomLDM: Latent Diffusion Model for multi-scale image generation25 Nov
- 2024Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Model19 Jul
Other references · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2017Prototypical Networks for Few-shot Learningcited by 3,001
- 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 387
- 2023Efficient Diffusion Training via Min-SNR Weighting Strategycited by 242
- 2024CtrLoRA: An Extensible and Efficient Framework for Controllable Image Generationcited by 21
- 2023ViT-DAE: Transformer-driven Diffusion Autoencoder for Histopathology Image Analysiscited by 15
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026A Generative Foundation Model for Multimodal Histopathology
- 2026Layout-Guided Controllable Pathology Image Generation with In-Context Diffusion Transformers
- 2025Semantic and Visual Crop-Guided Diffusion Models for Heterogeneous Tissue Synthesis in Histopathology
- 2026Controllable Histopathology Image Synthesis with Training-free Structural Initialization and Textural Modulation
- 2026HistDiT: A Structure-Aware Latent Conditional Diffusion Model for High-Fidelity Virtual Staining in Histopathology
- 2025PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditions
- 2025Graph Conditioned Diffusion for Controllable Histopathology Image Generation
- 2024Improving text-conditioned latent diffusion for cancer pathology