Universal CT Representations from Anatomy to Disease Phenotype through Agglomerative Pretraining
Not on the map. Why?
Abstract (arXiv)
Computed tomography (CT) is a central to three-dimensional medical imaging, yet CT-based artificial intelligence remains fragmented across task-specific models for segmentation, classification, registration, and report analysis. Here we present FlexiCT, a family of CT foundation models trained by agglomerative continual pretraining on 266,227 CT volumes from 56 publicly available datasets, forming a large-scale public resource for CT representation learning. FlexiCT uses agglomerative pretraining across three stages: two-dimensional axial pretraining, three-dimensional anatomical pretraining and report-guided semantic alignment. This training strategy supports slice-level, volume-level and vision-language analysis. Across five downstream task families (segmentation, classification, registration, vision-language understanding and clinical retrieval), FlexiCT matches or exceeds prior task-specific approaches on multiple benchmarks. Its embeddings further organize CT scans along gradients associated with various tumor stages, suggesting that CT foundation models can capture imaging features relevant to disease phenotype characterization. Project page and code are available at: https://ricklisz.github.io/flexict.github.io and https://github.com/ricklisz/FlexiCT.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 28 of its 50 references that are in the map. First posted on arXiv 21 May 2026.
Builds on
28 of 50 references.
References · 28
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2025Qwen3 Technical Reportcited by 8,820
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2025DINOv3cited by 1,414
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2023Vision Transformers Need Registerscited by 871
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 613
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 520
16 more
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 448
- 2022AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentationcited by 351
- 2016Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: the LUNA16 challengecited by 201
- 2024Generalist Foundation Models from a Multimodal Dataset for 3D Computed Tomographycited by 199
- 2019The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: Results of the KiTS19 Challengecited by 190
- 2022FlexiViT: One Model for All Patch Sizescited by 152
- 2024Merlin: A Computed Tomography Vision-Language Foundation Model and Datasetcited by 102
- 2025Vision Foundation Models for Computed Tomographycited by 47
- 2024TIPS: Text-Image Pretraining with Spatial awarenesscited by 37
- 2024Large-Scale 3D Medical Image Pre-training with Geometric Context Priorscited by 36
- 2021COVID-Net CT-2: Enhanced Deep Neural Networks for Detection of COVID-19 from Chest CT Images Through Bigger, More Diverse Learningcited by 29
- 2025Primus: Enforcing Attention Usage for 3D Medical Image Segmentationcited by 24
- 2024Automatic Organ and Pan-cancer Segmentation in Abdomen CT: the FLARE 2023 Challengecited by 23
- 2025Comprehensive language-image pre-training for 3D medical image understandingcited by 22
- 2025Curia: A Multi-Modal Foundation Model for Radiologycited by 15
- 2025Scaling Self-Supervised and Cross-Modal Pretraining for Volumetric CT Transformerscited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Big, Bright, or Invisible: A Frozen-Feature Benchmark of 3D CT Foundation Modelscited by 1
- 2026A digital-twin framework for forecasting treatment-day imaging with contour uncertainty in adaptive proton radiotherapycited by 1
- 2026OrganLens: Organ-Specific Representation Learning for CT Foundation Modelscited by 0
- 2026An Uncertainty-Guided Digital Twin Framework for Online Adaptive Proton Therapy in Head and Neck Cancer: A Feasibility Studycited by 0
- 2026An Uncertainty-Guided Digital Twin Framework for Online Adaptive Proton Therapy in Head and Neck Cancer: A Feasibility Study30 Sep 2026
- 2026A digital-twin framework for forecasting treatment-day imaging with contour uncertainty in adaptive proton radiotherapy21 Sep 2026
- 2026Big, Bright, or Invisible: A Frozen-Feature Benchmark of 3D CT Foundation Models6 Aug 2026
- 2026OrganLens: Organ-Specific Representation Learning for CT Foundation Models28 Jul 2026