mlsanityData to 14 Oct 2026

Representation-driven Endoscopic Visual Embedding Alignment for Latent Generation

arXiv 2608.07176 ↗First posted 7 Aug 2026cs.CV cs.AIcited by 0

On the map: Diffusion models → Medical imaging and segmentation

Abstract (arXiv)

Developing foundation generative models for endoscopy is limited by the gap between natural and clinical images and the computational cost of training large Diffusion Transformers. Although representation alignment has improved efficiency in general computer vision, its role within the highly specialized endoscopic image space remains unclear. We introduce REVEAL (Representation-driven Endoscopic Visual Embedding Alignment), the largest generative foundation model for endoscopy to date, trained on GastroNet-5M (GN-5M), a multicenter dataset of 5 million endoscopic frames. Instead of depending on out-of-domain priors, REVEAL employs encoders pretrained directly on the endoscopic distribution to align diffusion latents with domain-specific visual features, preserving fine textures and intricate anatomical structures. Beyond image generation, REVEAL also serves as a powerful feature extractor; in multiple benchmarks, it delivers performance that is competitive with, and in several cases exceeds, endoscopic foundation models such as EndoViT and Endo-FM, specifically tuned for classification tasks, while demonstrating strong representation robustness under realistic imaging corruptions. REVEAL produces high-fidelity images and maintains robust structural coherence in latent-space edits such as inpainting and outpainting. This high-capacity backbone lowers the computational threshold for building specialized clinical tools, offering an open, versatile foundation for conditional synthesis, segmentation, and out-of-distribution detection in future intelligent gastroenterology systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical imaging and segmentation, one of 14 directions in Diffusion models. Builds on 26 of its 41 references that are in the map. First posted on arXiv 7 Aug 2026.

Builds on

26 of 41 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Loss7 Aug
  2. 2025MedSymmFlow: Bridging Generative Modeling and Classification in Medical Imaging through Symmetrical Flow Matching25 Jul
  3. 2025Conditional Diffusion Models are Medical Image Classifiers that Provide Explainability and Uncertainty for Free6 Feb
  4. 2024Polyp-DDPM: Diffusion-Based Semantic Polyp Synthesis for Enhanced Segmentation6 Feb
  5. 2023Mask-conditioned latent diffusion for generating gastrointestinal polyp images11 Apr

Other references · 21

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  5. 2025DINOv3cited by 1,414
  6. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
  7. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 737
  8. 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 703
  9. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
  10. 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 225
  11. 2025What matters for Representation Alignment: Global Information or Spatial Structure?cited by 84
  12. 2023Foundation Model for Endoscopy Video Analysis via Large-scale Self-supervised Pre-traincited by 75
9 more
  1. 2024Endora: Video Generation Models as Endoscopy Simulatorscited by 55
  2. 2020Smoothness and Stability in GANscited by 27
  3. 2023Gradpaint: Gradient-Guided Inpainting with Diffusion Modelscited by 17
  4. 2025LanPaint: Training-Free Diffusion Inpainting with Asymptotically Exact and Fast Conditional Samplingcited by 11
  5. 2025EndoMamba: An Efficient Foundation Model for Endoscopic Videos via Hierarchical Pre-trainingcited by 11
  6. 2023This Intestine Does Not Exist: Multiscale Residual Variational Autoencoder for Realistic Wireless Capsule Endoscopy Image Generationcited by 9
  7. 2025Polyp-Gen: Realistic and Diverse Polyp Image Generation for Endoscopic Dataset Expansioncited by 9
  8. 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Modelscited by 8
  9. 2025Multiscale Vector-Quantized Variational Autoencoder for Endoscopic Image Synthesiscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026EndoVLM: An Endoscopy Vision-Language Pre-training Model via Anatomy-Guided Sparsity and Progressive Alignment
  2. 2026PolypSteer: Counterfactual Endoscopic Synthesis via Training-Free Activation Steering
  3. 2025MetaFE-DE: Learning Meta Feature Embedding for Depth Estimation from Monocular Endoscopic Images
  4. 2026From Generalist to Specialist: A Context-Fusion Framework for Endoscopic Polyp Reporting with a Frozen VLM
  5. 2026GALAR-TemporalNet v2: Anatomy-Guided Dual-Branch Temporal Classification with Bidirectional Mamba and Dual-Graph GCN for Video Capsule Endoscopy -- after competition results
  6. 2026LUX: A Lesion-Aware Graph-Conditioned Visual - Language Architecture for Explainable Endoscopic Captioning
  7. 2025EndoBench: A Comprehensive Evaluation of Multi-Modal Large Language Models for Endoscopy Analysis
  8. 2025EndoStreamDepth: Temporally Consistent Monocular Depth Estimation for Endoscopic Video Streams