REAL-Colon: A dataset for developing real-world AI applications in colonoscopy
Not on the map. Why?
Abstract (arXiv)
Detection and diagnosis of colon polyps are key to preventing colorectal cancer. Recent evidence suggests that AI-based computer-aided detection (CADe) and computer-aided diagnosis (CADx) systems can enhance endoscopists' performance and boost colonoscopy effectiveness. However, most available public datasets primarily consist of still images or video clips, often at a down-sampled resolution, and do not accurately represent real-world colonoscopy procedures. We introduce the REAL-Colon (Real-world multi-center Endoscopy Annotated video Library) dataset: a compilation of 2.7M native video frames from sixty full-resolution, real-world colonoscopy recordings across multiple centers. The dataset contains 350k bounding-box annotations, each created under the supervision of expert gastroenterologists. Comprehensive patient clinical data, colonoscopy acquisition information, and polyp histopathological information are also included in each video. With its unprecedented size, quality, and heterogeneity, the REAL-Colon dataset is a unique resource for researchers and developers aiming to advance AI research in colonoscopy. Its openness and transparency facilitate rigorous and reproducible research, fostering the development and benchmarking of more accurate and reliable colonoscopy-related algorithms and models.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 6 of its 37 references that are in the map. First posted on arXiv 4 Mar 2024.
Builds on
6 of 37 references.
References · 6
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2019Kvasir-SEG: A Segmented Polyp Datasetcited by 588
- 2021A multi-centre polyp detection and segmentation dataset for generalisability assessmentcited by 63
- 2021Colonoscopy Polyp Detection and Classification: Dataset Creation and Comparative Evaluationscited by 38
- 2022Assessing generalisability of deep learning-based polyp detection and segmentation methods through a computer vision challengecited by 27
- 2020Medico Multimedia Task at MediaEval 2020: Automatic Polyp Segmentationcited by 14
Built on by
Citing papers per year: 2024: 3; 2025: 8; 2026: 9.
20 papers.
Sort:
By area:
- 2024Large Language Model Benchmarks in Medical Taskscited by 16
- 2024Frontiers in Intelligent Colonoscopycited by 13
- 2025SurgViVQA: Temporally-Grounded Video Question Answering for Surgical Scene Understandingcited by 7
- 2024Hard-Attention Gates with Gradient Routing for Endoscopic Image Computingcited by 3
- 2025PolypSegTrack: Unified Foundation Model for Colonoscopy Video Analysiscited by 3
- 2026MedHorizon: Towards Long-context Medical Video Understanding in the Wildcited by 3
- 2025Towards Polyp Counting In Full-Procedure Colonoscopy Videoscited by 2
- 2025A Temporal Convolutional Network-Based Approach and a Benchmark Dataset for Colonoscopy Video Temporal Segmentationcited by 1
- 2025Temporally-Aware Supervised Contrastive Learning for Polyp Counting in Colonoscopycited by 1
- 2025RRTS Dataset: A Benchmark Colonoscopy Dataset from Resource-Limited Settings for Computer-Aided Diagnosis Researchcited by 1
- 2026Colon-Bench: An Agentic Workflow for Scalable Dense Lesion Annotation in Full-Procedure Colonoscopy Videoscited by 1
- 2026SAGE: An Expert-Annotated South Asian GI Endoscopy Dataset for Multimodal Learning and Hallucination Analysiscited by 1
8 more
- 2025From Scope to Script: An Automated Report Generation Model for Gastrointestinal Endoscopycited by 0
- 2025C3VDReg: A Benchmark for Local-to-Local Colonoscopic Registration toward Anatomical Localizationcited by 0
- 2026TemporalDoRA: Temporal PEFT for Robust Surgical Video Question Answeringcited by 0
- 2026Contrastive Learning under Noisy Temporal Self-Supervision for Colonoscopy Videoscited by 0
- 2026Understanding Model Behavior in Monocular Polyp Sizingcited by 0
- 2026TRUE-Colon: Exposing a Consistent Transfer Asymmetry in Real-Time Polyp Detectioncited by 0
- 2026woma: a real-time foundation model and its fine-tuned models for endoscopycited by 0
- 2026Lesion-centered 3D mapping of colonoscopy procedures: validation of a hierarchical ensemble pipeline on public benchmark videoscited by 0
- 2026Lesion-centered 3D mapping of colonoscopy procedures: validation of a hierarchical ensemble pipeline on public benchmark videos15 Sep 2026
- 2026woma: a real-time foundation model and its fine-tuned models for endoscopy14 Sep 2026
- 2026TRUE-Colon: Exposing a Consistent Transfer Asymmetry in Real-Time Polyp Detection13 Aug 2026
- 2026SAGE: An Expert-Annotated South Asian GI Endoscopy Dataset for Multimodal Learning and Hallucination Analysis20 Jun 2026
- 2026Understanding Model Behavior in Monocular Polyp Sizing19 May 2026
- 2026Contrastive Learning under Noisy Temporal Self-Supervision for Colonoscopy Videos12 May 2026
- 2026MedHorizon: Towards Long-context Medical Video Understanding in the Wild7 May 2026
- 2026Colon-Bench: An Agentic Workflow for Scalable Dense Lesion Annotation in Full-Procedure Colonoscopy Videos26 Mar 2026
- 2026TemporalDoRA: Temporal PEFT for Robust Surgical Video Question Answering10 Mar 2026
- 2025RRTS Dataset: A Benchmark Colonoscopy Dataset from Resource-Limited Settings for Computer-Aided Diagnosis Research10 Nov 2025
- 2025SurgViVQA: Temporally-Grounded Video Question Answering for Surgical Scene Understanding5 Nov 2025
- 2025C3VDReg: A Benchmark for Local-to-Local Colonoscopic Registration toward Anatomical Localization31 Oct 2025
8 more
- 2025From Scope to Script: An Automated Report Generation Model for Gastrointestinal Endoscopy3 Oct 2025
- 2025Temporally-Aware Supervised Contrastive Learning for Polyp Counting in Colonoscopy3 Jul 2025
- 2025PolypSegTrack: Unified Foundation Model for Colonoscopy Video Analysis31 Mar 2025
- 2025Towards Polyp Counting In Full-Procedure Colonoscopy Videos14 Feb 2025
- 2025A Temporal Convolutional Network-Based Approach and a Benchmark Dataset for Colonoscopy Video Temporal Segmentation5 Feb 2025
- 2024Large Language Model Benchmarks in Medical Tasks28 Oct 2024
- 2024Frontiers in Intelligent Colonoscopy22 Oct 2024
- 2024Hard-Attention Gates with Gradient Routing for Endoscopic Image Computing5 Jul 2024
- 2024Large Language Model Benchmarks in Medical Taskscited by 16
- 2024Frontiers in Intelligent Colonoscopycited by 13
- 2025SurgViVQA: Temporally-Grounded Video Question Answering for Surgical Scene Understandingcited by 7
- 2024Hard-Attention Gates with Gradient Routing for Endoscopic Image Computingcited by 3
- 2025PolypSegTrack: Unified Foundation Model for Colonoscopy Video Analysiscited by 3
- 2025Towards Polyp Counting In Full-Procedure Colonoscopy Videoscited by 2
- 2025A Temporal Convolutional Network-Based Approach and a Benchmark Dataset for Colonoscopy Video Temporal Segmentationcited by 1
- 2025Temporally-Aware Supervised Contrastive Learning for Polyp Counting in Colonoscopycited by 1
- 2025RRTS Dataset: A Benchmark Colonoscopy Dataset from Resource-Limited Settings for Computer-Aided Diagnosis Researchcited by 1
- 2026Colon-Bench: An Agentic Workflow for Scalable Dense Lesion Annotation in Full-Procedure Colonoscopy Videoscited by 1
- 2026SAGE: An Expert-Annotated South Asian GI Endoscopy Dataset for Multimodal Learning and Hallucination Analysiscited by 1
- 2025From Scope to Script: An Automated Report Generation Model for Gastrointestinal Endoscopycited by 0
12 most cited of 19 All 19 (JSON)
- 2026Lesion-centered 3D mapping of colonoscopy procedures: validation of a hierarchical ensemble pipeline on public benchmark videos15 Sep 2026
- 2026woma: a real-time foundation model and its fine-tuned models for endoscopy14 Sep 2026
- 2026TRUE-Colon: Exposing a Consistent Transfer Asymmetry in Real-Time Polyp Detection13 Aug 2026
- 2026SAGE: An Expert-Annotated South Asian GI Endoscopy Dataset for Multimodal Learning and Hallucination Analysis20 Jun 2026
- 2026Understanding Model Behavior in Monocular Polyp Sizing19 May 2026
- 2026Contrastive Learning under Noisy Temporal Self-Supervision for Colonoscopy Videos12 May 2026
- 2026Colon-Bench: An Agentic Workflow for Scalable Dense Lesion Annotation in Full-Procedure Colonoscopy Videos26 Mar 2026
- 2026TemporalDoRA: Temporal PEFT for Robust Surgical Video Question Answering10 Mar 2026
- 2025RRTS Dataset: A Benchmark Colonoscopy Dataset from Resource-Limited Settings for Computer-Aided Diagnosis Research10 Nov 2025
- 2025SurgViVQA: Temporally-Grounded Video Question Answering for Surgical Scene Understanding5 Nov 2025
- 2025C3VDReg: A Benchmark for Local-to-Local Colonoscopic Registration toward Anatomical Localization31 Oct 2025
- 2025From Scope to Script: An Automated Report Generation Model for Gastrointestinal Endoscopy3 Oct 2025
12 newest of 19 All 19 (JSON)