DiffInfinite: Large Mask-Image Synthesis via Parallel Random Patch Diffusion in Histopathology
On the map: Diffusion models → Medical imaging and segmentation
Abstract (arXiv)
We present DiffInfinite, a hierarchical diffusion model that generates arbitrarily large histological images while preserving long-range correlation structural information. Our approach first generates synthetic segmentation masks, subsequently used as conditions for the high-fidelity generative diffusion process. The proposed sampling method can be scaled up to any desired image size while only requiring small patches for fast training. Moreover, it can be parallelized more efficiently than previous large-content generation methods while avoiding tiling artifacts. The training leverages classifier-free guidance to augment a small, sparsely annotated dataset with unlabelled data. Our method alleviates unique challenges in histopathological imaging practice: large-scale information, costly manual annotation, and protective data handling. The biological plausibility of DiffInfinite data is evaluated in a survey by ten experienced pathologists as well as a downstream classification and segmentation task. Samples from the model score strongly on anti-copying metrics which is relevant for the protection of patient data.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 61 of its 82 references that are in the map. First posted on arXiv 23 Jun 2023.
Builds on
61 of 82 references.
Closest ancestors · 4
Same direction, newest first
- 2023Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedback16 Jun
- 2023NASDM: Nuclei-Aware Semantic Histopathology Image Generation Using Diffusion Models20 Mar
- 2022Adapting Pretrained Vision-Language Foundational Models to Medical Imaging Domains9 Oct
- 2022A Morphology Focused Diffusion Probabilistic Model for Synthesis of Histopathology Images27 Sep
Other references · 57
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2016Improved Techniques for Training GANscited by 2,938
38 more
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2017Deep Image Priorcited by 1,097
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 925
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2020The Future of Digital Health with Federated Learningcited by 625
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 578
- 2018Rotation Equivariant CNNs for Digital Pathologycited by 420
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 418
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 357
- 2023The Curse of Recursion: Training on Generated Data Makes Models Forgetcited by 343
- 2018A Note on the Inception Scorecited by 225
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
- 2022The Role of ImageNet Classes in Fr'echet Inception Distancecited by 211
- 2021How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Modelscited by 193
- 2023SegGPT: Segmenting Everything In Contextcited by 193
- 2022Measuring Forgetting of Memorized Training Examplescited by 118
- 2023DiffCollage: Parallel Generation of Large Content with Diffusion Modelscited by 100
- 2023On Provable Copyright Protection for Generative Modelscited by 97
- 2022RoentGen: Vision-Language Foundation Model for Chest X-ray Generationcited by 89
- 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
- 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
- 2020A Non-Parametric Test to Detect Data-Copying in Generative Modelscited by 52
- 2020Guidance and Evaluation: Semantic-Aware Image Inpainting for Mixed Scenescited by 43
- 2022SinDiffusion: Learning a Diffusion Model from a Single Natural Imagecited by 42
- 2022Can segmentation models be trained with fully synthetically generated data?cited by 37
- 2021Selective Synthetic Augmentation with HistoGAN for Improved Histopathology Image Classificationcited by 35
- 2019PathologyGAN: Learning deep representations of cancer tissuecited by 32
- 2019Resolving challenges in deep learning-based analyses of histopathological images using explanation methodscited by 32
- 2018Painting Outside the Box: Image Outpainting with GANscited by 30
- 2020VCNet: A Robust Approach to Blind Image Inpaintingcited by 25
- 2020Red-GAN: Attacking class imbalance via conditioned generation. Yet another perspective on medical image synthesis for skin lesion dermoscopy and brain tumor MRIcited by 17
- 2019Introducing Hann windows for reducing edge-effects in patch-based image segmentationcited by 16
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2023: 3; 2024: 8; 2025: 12; 2026: 5.
28 papers.
Sort:
By area:
- 2023Learned representation-guided diffusion models for large-image generationcited by 39
- 2024TopoCellGen: Generating Histopathology Cell Topology with a Diffusion Modelcited by 16
- 2024ZoomLDM: Latent Diffusion Model for multi-scale image generationcited by 15
- 2024Is One GPU Enough? Pushing Image Generation at Higher-Resolutions with Foundation Modelscited by 14
- 2023Generative Fractional Diffusion Modelscited by 12
- 2024Analyzing Tumors by Synthesiscited by 11
- 2025PixCell: A generative foundation model for digital histopathology imagescited by 11
- 2024VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesiscited by 8
- 2025PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditionscited by 8
- 2025MeDi: Metadata-Guided Diffusion Models for Mitigating Biases in Tumor Classificationcited by 6
- 2025Content Generation Models in Computational Pathology: A Comprehensive Survey on Methods, Applications, and Challengescited by 5
- 2025Multimodal LLM-Guided Semantic Correction in Text-to-Image Diffusioncited by 5
16 more
- 2023Latent Diffusion Models with Image-Derived Annotations for Enhanced AI-Assisted Cancer Diagnosis in Histopathologycited by 3
- 2025PathoPainter: Augmenting Histopathology Segmentation via Tumor-aware Inpaintingcited by 3
- 2025Semantic and Visual Crop-Guided Diffusion Models for Heterogeneous Tissue Synthesis in Histopathologycited by 3
- 2025Fractional Diffusion Bridge Modelscited by 3
- 2024Mask-guided cross-image attention for zero-shot in-silico histopathologic image generation with a diffusion modelcited by 2
- 2024Synthetic Generation of Dermatoscopic Images with GAN and Closed-Form Factorizationcited by 1
- 2025Physics-informed DeepCT: Sinogram Wavelet Decomposition Meets Masked Diffusioncited by 1
- 2025NDM: A Noise-driven Detection and Mitigation Framework against Implicit Sexual Intentions in Text-to-Image Generationcited by 1
- 2026Patch-to-Global: Random Patch Diffusion for Globally Consistent Megapixel Artifact Inpainting in Whole Slide Imagescited by 1
- 2024Evaluating Utility of Memory Efficient Medical Image Generation: A Study on Lung Nodule Segmentationcited by 0
- 2025StructDiff: Structure-aware Diffusion Model for 3D Fine-grained Medical Image Synthesiscited by 0
- 2025MSDM: Generating Task-Specific Pathology Images with a Multimodal Conditioned Diffusion Model for Cell and Nuclei Segmentationcited by 0
- 2026Disentangled Anatomy-Disease Diffusion (DADD) for Controllable Ulcerative Colitis Progression Synthesiscited by 0
- 2026PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Imagescited by 0
- 2026UniNDM: A Unified Noise-driven Detection and Mitigation Framework Against Sexual Content in Text-to-Image Generationcited by 0
- 2026P-PatchDiff: Progressive Patch Diffusion Models for Low-light Image Enhancementcited by 0
- 2026Patch-to-Global: Random Patch Diffusion for Globally Consistent Megapixel Artifact Inpainting in Whole Slide Images21 Sep 2026
- 2026P-PatchDiff: Progressive Patch Diffusion Models for Low-light Image Enhancement1 Sep 2026
- 2026UniNDM: A Unified Noise-driven Detection and Mitigation Framework Against Sexual Content in Text-to-Image Generation18 Jul 2026
- 2026PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Images1 Jun 2026
- 2026Disentangled Anatomy-Disease Diffusion (DADD) for Controllable Ulcerative Colitis Progression Synthesis3 May 2026
- 2025Fractional Diffusion Bridge Models3 Nov 2025
- 2025NDM: A Noise-driven Detection and Mitigation Framework against Implicit Sexual Intentions in Text-to-Image Generation17 Oct 2025
- 2025MSDM: Generating Task-Specific Pathology Images with a Multimodal Conditioned Diffusion Model for Cell and Nuclei Segmentation10 Oct 2025
- 2025Semantic and Visual Crop-Guided Diffusion Models for Heterogeneous Tissue Synthesis in Histopathology22 Sep 2025
- 2025PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditions30 Jun 2025
- 2025MeDi: Metadata-Guided Diffusion Models for Mitigating Biases in Tumor Classification20 Jun 2025
- 2025PixCell: A generative foundation model for digital histopathology images5 Jun 2025
16 more
- 2025Multimodal LLM-Guided Semantic Correction in Text-to-Image Diffusion26 May 2025
- 2025Content Generation Models in Computational Pathology: A Comprehensive Survey on Methods, Applications, and Challenges16 May 2025
- 2025StructDiff: Structure-aware Diffusion Model for 3D Fine-grained Medical Image Synthesis12 Mar 2025
- 2025PathoPainter: Augmenting Histopathology Segmentation via Tumor-aware Inpainting6 Mar 2025
- 2025Physics-informed DeepCT: Sinogram Wavelet Decomposition Meets Masked Diffusion17 Jan 2025
- 2024TopoCellGen: Generating Histopathology Cell Topology with a Diffusion Model8 Dec 2024
- 2024ZoomLDM: Latent Diffusion Model for multi-scale image generation25 Nov 2024
- 2024Evaluating Utility of Memory Efficient Medical Image Generation: A Study on Lung Nodule Segmentation16 Oct 2024
- 2024Synthetic Generation of Dermatoscopic Images with GAN and Closed-Form Factorization7 Oct 2024
- 2024Analyzing Tumors by Synthesis9 Sep 2024
- 2024Mask-guided cross-image attention for zero-shot in-silico histopathologic image generation with a diffusion model16 Jul 2024
- 2024Is One GPU Enough? Pushing Image Generation at Higher-Resolutions with Foundation Models11 Jun 2024
- 2024VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesis9 May 2024
- 2023Latent Diffusion Models with Image-Derived Annotations for Enhanced AI-Assisted Cancer Diagnosis in Histopathology15 Dec 2023
- 2023Learned representation-guided diffusion models for large-image generation12 Dec 2023
- 2023Generative Fractional Diffusion Models26 Oct 2023
- 2023Learned representation-guided diffusion models for large-image generationcited by 39
- 2024TopoCellGen: Generating Histopathology Cell Topology with a Diffusion Modelcited by 16
- 2024ZoomLDM: Latent Diffusion Model for multi-scale image generationcited by 15
- 2023Generative Fractional Diffusion Modelscited by 12
- 2024VM-DDPM: Vision Mamba Diffusion for Medical Image Synthesiscited by 8
- 2025PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditionscited by 8
- 2025MeDi: Metadata-Guided Diffusion Models for Mitigating Biases in Tumor Classificationcited by 6
- 2023Latent Diffusion Models with Image-Derived Annotations for Enhanced AI-Assisted Cancer Diagnosis in Histopathologycited by 3
- 2025Semantic and Visual Crop-Guided Diffusion Models for Heterogeneous Tissue Synthesis in Histopathologycited by 3
- 2024Mask-guided cross-image attention for zero-shot in-silico histopathologic image generation with a diffusion modelcited by 2
- 2025Physics-informed DeepCT: Sinogram Wavelet Decomposition Meets Masked Diffusioncited by 1
- 2025NDM: A Noise-driven Detection and Mitigation Framework against Implicit Sexual Intentions in Text-to-Image Generationcited by 1
12 most cited of 17 All 17 (JSON)
- 2026P-PatchDiff: Progressive Patch Diffusion Models for Low-light Image Enhancement1 Sep 2026
- 2026UniNDM: A Unified Noise-driven Detection and Mitigation Framework Against Sexual Content in Text-to-Image Generation18 Jul 2026
- 2025NDM: A Noise-driven Detection and Mitigation Framework against Implicit Sexual Intentions in Text-to-Image Generation17 Oct 2025
- 2025MSDM: Generating Task-Specific Pathology Images with a Multimodal Conditioned Diffusion Model for Cell and Nuclei Segmentation10 Oct 2025
- 2025Semantic and Visual Crop-Guided Diffusion Models for Heterogeneous Tissue Synthesis in Histopathology22 Sep 2025
- 2025PathDiff: Histopathology Image Synthesis with Unpaired Text and Mask Conditions30 Jun 2025
- 2025MeDi: Metadata-Guided Diffusion Models for Mitigating Biases in Tumor Classification20 Jun 2025
- 2025StructDiff: Structure-aware Diffusion Model for 3D Fine-grained Medical Image Synthesis12 Mar 2025
- 2025Physics-informed DeepCT: Sinogram Wavelet Decomposition Meets Masked Diffusion17 Jan 2025
- 2024TopoCellGen: Generating Histopathology Cell Topology with a Diffusion Model8 Dec 2024
- 2024ZoomLDM: Latent Diffusion Model for multi-scale image generation25 Nov 2024
- 2024Evaluating Utility of Memory Efficient Medical Image Generation: A Study on Lung Nodule Segmentation16 Oct 2024
12 newest of 17 All 17 (JSON)
- 2024Is One GPU Enough? Pushing Image Generation at Higher-Resolutions with Foundation Modelscited by 14
- 2024Analyzing Tumors by Synthesiscited by 11
- 2025PixCell: A generative foundation model for digital histopathology imagescited by 11
- 2025Content Generation Models in Computational Pathology: A Comprehensive Survey on Methods, Applications, and Challengescited by 5
- 2025PathoPainter: Augmenting Histopathology Segmentation via Tumor-aware Inpaintingcited by 3
- 2025Fractional Diffusion Bridge Modelscited by 3
- 2024Synthetic Generation of Dermatoscopic Images with GAN and Closed-Form Factorizationcited by 1
- 2026Patch-to-Global: Random Patch Diffusion for Globally Consistent Megapixel Artifact Inpainting in Whole Slide Imagescited by 1
- 2026Disentangled Anatomy-Disease Diffusion (DADD) for Controllable Ulcerative Colitis Progression Synthesiscited by 0
- 2026PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Imagescited by 0
- 2026Patch-to-Global: Random Patch Diffusion for Globally Consistent Megapixel Artifact Inpainting in Whole Slide Images21 Sep 2026
- 2026PathAR: Structure-First Autoregressive Synthesis of Multimodal Pathology Images1 Jun 2026
- 2026Disentangled Anatomy-Disease Diffusion (DADD) for Controllable Ulcerative Colitis Progression Synthesis3 May 2026
- 2025Fractional Diffusion Bridge Models3 Nov 2025
- 2025PixCell: A generative foundation model for digital histopathology images5 Jun 2025
- 2025Content Generation Models in Computational Pathology: A Comprehensive Survey on Methods, Applications, and Challenges16 May 2025
- 2025PathoPainter: Augmenting Histopathology Segmentation via Tumor-aware Inpainting6 Mar 2025
- 2024Synthetic Generation of Dermatoscopic Images with GAN and Closed-Form Factorization7 Oct 2024
- 2024Analyzing Tumors by Synthesis9 Sep 2024
- 2024Is One GPU Enough? Pushing Image Generation at Higher-Resolutions with Foundation Models11 Jun 2024
Similar, not cited
Close in wording, no citation either way
- 2026A Generative Foundation Model for Multimodal Histopathology
- 2026Controllable Histopathology Image Synthesis with Training-free Structural Initialization and Textural Modulation
- 2025Prototype-Guided Diffusion for Digital Pathology: Achieving Foundation Model Performance with Minimal Clinical Data
- 2025Graph Conditioned Diffusion for Controllable Histopathology Image Generation
- 2026Assessment of Conditional Diffusion Model for Synthetic Histopathology Image Generation
- 2024Style-Extracting Diffusion Models for Semi-Supervised Histopathology Segmentation
- 2025HistoSmith: Single-Stage Histology Image-Label Generation via Conditional Latent Diffusion for Enhanced Cell Segmentation and Classification
- 2026STREAM: Stochastic Riemannian Flow Matching with Anisotropic Decoder for Digital Histopathology Image Generation