mlsanityData to 14 Oct 2026

woma: a real-time foundation model and its fine-tuned models for endoscopy

arXiv 2609.15130 ↗First posted 14 Sep 2026cs.SE cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

woma is a real-time foundation model for gastrointestinal endoscopy: a network trained without labels on about a million endoscopy frames, from which task models are fine-tuned. We contribute a systematic design for production. Requirements and pass marks were fixed before any run, eight candidates screened under pre-registered rules, self-supervised training taken to a stopping rule, then fine-tuning and deployment optimisation, all on one self-contained library, numbat. We also contribute woma itself with two fine-tuned models, every outcome reported met or missed. Our colonoscopy model finds and outlines polyps, names which colon segment is in view, suggests polyp type and grades bowel preparation. Our gastroscopy model names a station out of 22 protocol sites, flags and outlines lesions, and names one of seven findings. Every number was read on data never seen in training, and shipped weights were chosen on that record. In colonoscopy, 96% of polyps in a six-hospital PolypGen set are found at precision >=0.85, and 19 of 19 polyps across fifteen full REAL-Colon videos at 1.6 false alarms per procedure. In gastroscopy, landmark region is named correctly on 92% of frames from unseen patients, and 37 of 39 held-out neoplasia frames are flagged at specificity 0.91. On one workstation GPU every task runs over 1080p video at about 100 frames per second, faster than PyTorch, ONNX Runtime and TensorRT in all four precision regimes tested. TensorRT comes closest: one pass of our foundation model takes it 3 to 27% longer than ours, and we deliver 6 to 31% more frames per second from frame to results. A second build links no vendor library at all -- our own kernels over Vulkan -- so a site deploys two files and needs no toolkit, no cuDNN and no framework; in f32 it beats the CUDA build on the same card.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 56 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

26 of 56 references.

References · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  7. 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
  8. 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
  9. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
  10. 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 589
  11. 2020PraNet: Parallel Reverse Attention Network for Polyp Segmentationcited by 460
  12. 2020Generalized Focal Loss: Learning Qualified and Distributed Bounding Boxes for Dense Object Detectioncited by 409
14 more
  1. 2019Making Convolutional Networks Shift-Invariant Againcited by 391
  2. 2016A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Imagescited by 221
  3. 2023Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modelingcited by 94
  4. 2021Self-Supervised Pretraining Improves Self-Supervised Pretrainingcited by 82
  5. 2022Video Polyp Segmentation: A Deep Learning Perspectivecited by 82
  6. 2021A multi-centre polyp detection and segmentation dataset for generalisability assessmentcited by 63
  7. 2021Colonoscopy Polyp Detection and Classification: Dataset Creation and Comparative Evaluationscited by 38
  8. 2022Assessing generalisability of deep learning-based polyp detection and segmentation methods through a computer vision challengecited by 27
  9. 2023GastroVision: A Multi-class Endoscopy Image Dataset for Computer Aided Gastrointestinal Disease Detectioncited by 20
  10. 2024REAL-Colon: A dataset for developing real-world AI applications in colonoscopycited by 20
  11. 2026Cross-Stack Validation of Language-Model Training: A Clinical Fine-Tuning Case Studycited by 2
  12. 2026GIM-ENDO: A Multimodal Endoscopic Image and Video Dataset for Gastric Intestinal Metaplasia Morphology and Pathologycited by 1
  13. 2026SAGE: An Expert-Annotated South Asian GI Endoscopy Dataset for Multimodal Learning and Hallucination Analysiscited by 1
  14. 2026Numbat: Building and Verifying a Self-Contained Machine-Learning Stackcited by 1

Built on by

Not cited yet.