The Multi-modality Cell Segmentation Challenge: Towards Universal Solutions
Not on the map. Why?
Abstract (arXiv)
Cell segmentation is a critical step for quantitative single-cell analysis in microscopy images. Existing cell segmentation methods are often tailored to specific modalities or require manual interventions to specify hyper-parameters in different experimental settings. Here, we present a multi-modality cell segmentation benchmark, comprising over 1500 labeled images derived from more than 50 diverse biological experiments. The top participants developed a Transformer-based deep-learning algorithm that not only exceeds existing methods but can also be applied to diverse microscopy images across imaging platforms and tissue types without manual parameter adjustments. This benchmark and the improved algorithm offer promising avenues for more accurate and versatile cell analysis in microscopy imaging.
Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Builds on 29 of its 75 references that are in the map. First posted on arXiv 10 Aug 2023.
Builds on
29 of 75 references.
References · 29
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2017Mask R-CNNcited by 7,277
- 2022A ConvNet for the 2020scited by 3,579
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,630
17 more
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,330
- 2018HoVer-Net: Simultaneous Segmentation and Classification of Nuclei in Multi-Tissue Histology Imagescited by 388
- 2019Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentationcited by 260
- 2023Segment Anything in Medical Imagescited by 227
- 2022Metrics reloaded: Recommendations for image analysis validationcited by 195
- 2018Cell Detection with Star-convex Polygonscited by 183
- 2020Using Hindsight to Anchor Past Knowledge in Continual Learningcited by 161
- 2018Why rankings of biomedical image analysis competitions should be interpreted with carecited by 91
- 2022Unbiased Teacher v2: Semi-supervised Object Detection for Anchor-free and Anchor-based Detectorscited by 69
- 2019Methods and open-source toolkit for analyzing and visualizing challenge resultscited by 60
- 2019Multi-Task Attention-Based Semi-Supervised Learning for Medical Image Segmentationcited by 55
- 2023CoNIC Challenge: Pushing the Frontiers of Nuclear Detection, Segmentation, Classification and Countingcited by 33
- 2020Localization Uncertainty Estimation for Anchor-Free Object Detectioncited by 19
- 2021Contour Proposal Networks for Biomedical Instance Segmentationcited by 13
- 2022MEDIAR: Harmony of Data-Centric and Model-Centric for Multi-Modality Microscopycited by 10
- 2019J Regularization Improves Imbalanced Multiclass Segmentationcited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 17; 2025: 11; 2026: 10.
39 papers.
Sort:
By area:
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 419
- 2024Swin-UMamba: Mamba-based UNet with ImageNet-based pretrainingcited by 179
- 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 109
- 2024Vision Mamba: A Comprehensive Survey and Taxonomycited by 54
- 2024Segment Anything in Medical Images and Videos: Benchmark and Deploymentcited by 42
- 2024Biomedical SAM 2: Segment Anything in Biomedical Images and Videoscited by 14
- 2024xLSTM-UNet can be an Effective 2D & 3D Medical Image Segmentation Backbone with Vision-LSTM (ViL) better than its Mamba Counterpartcited by 12
- 2024ViM-UNet: Vision Mamba for Biomedical Segmentationcited by 11
- 2024Multimodal Data Integration for Precision Oncology: Challenges and Future Directionscited by 10
- 2024Cell Graph Transformer for Nuclei Classificationcited by 9
- 2024LoG-VMamba: Local-Global Vision Mamba for Medical Image Segmentationcited by 9
- 2024HoloHisto: End-to-end Gigapixel WSI Segmentation with 4K Resolution Sequential Tokenizationcited by 8
27 more
- 2025SAM3-Adapter: Efficient Adaptation of Segment Anything 3 for Camouflage Object Segmentation, Shadow Detection, and Medical Image Segmentationcited by 7
- 2024CellSeg1: Robust Cell Segmentation with One Training Imagecited by 6
- 2024TTT-Unet: Enhancing U-Net with Test-Time Training Layers for Biomedical Image Segmentationcited by 3
- 2025Enhancing Feature Fusion of U-like Networks with Dynamic Skip Connectionscited by 3
- 2023Defining the boundaries: challenges and advances in identifying cells in microscopy imagescited by 2
- 2024UniCell: Universal Cell Nucleus Classification via Prompt Learningcited by 1
- 2025PyUAT: Open-source Python framework for efficient and scalable cell trackingcited by 1
- 2025Fast Sphericity and Roundness approximation in 2D and 3D using Local Thicknesscited by 1
- 2025MedVKAN: Efficient Feature Extraction with Mamba and KAN for Medical Image Segmentationcited by 1
- 2025SEMA: a Scalable and Efficient Mamba like Attention via Token Localization and Averagingcited by 1
- 2025NOA: a versatile, extensible tool for AI-based organoid analysiscited by 1
- 2024CHOTA: A Higher Order Accuracy Metric for Cell Trackingcited by 0
- 2024CellPilot: A unified approach to automatic and interactive segmentation in histopathologycited by 0
- 2025From Claims to Evidence: A Unified Framework and Critical Analysis of CNN vs. Transformer vs. Mamba in Medical Image Segmentationcited by 0
- 2025SAMJ: Fast Image Annotation on ImageJ/Fiji via Segment Anything Modelcited by 0
- 2025Data Efficiency and Transfer Robustness in Biomedical Image Segmentation: A Study of Redundancy and Forgetting with Cellposecited by 0
- 2025Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimizationcited by 0
- 2026Cell Behavior Video Classification Challenge, a benchmark for computer vision methods in time-lapse microscopycited by 0
- 2026Personalized Cell Segmentation: Benchmark and Framework for Reference-Guided Cell Type Segmentationcited by 0
- 2026UCell: rethinking generalizability and scaling of bio-medical vision modelscited by 0
- 2026Probing Intrinsic Medical Task Relationships: A Contrastive Learning Perspectivecited by 0
- 2026Attention Is not Everything: Efficient Alternatives for Visioncited by 0
- 2026USEMA: a Scalable Efficient Mamba Like Attention for Medical Image Segmentationcited by 0
- 2026MicroscopyMatching: Towards a Ready-to-use Framework for Microscopy Image Analysis in Diverse Conditionscited by 0
- 2026MedCAGD: Context-Aware Gated Decoder for Efficient Medical Image Segmentationcited by 0
- 2026HASSL: Hierarchy-Aware Self-Supervised Learning Framework for Single Cell Microscopycited by 0
- 2026QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentationcited by 0
- 2026QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation29 Aug 2026
- 2026HASSL: Hierarchy-Aware Self-Supervised Learning Framework for Single Cell Microscopy5 Jul 2026
- 2026MedCAGD: Context-Aware Gated Decoder for Efficient Medical Image Segmentation1 Jul 2026
- 2026MicroscopyMatching: Towards a Ready-to-use Framework for Microscopy Image Analysis in Diverse Conditions14 May 2026
- 2026USEMA: a Scalable Efficient Mamba Like Attention for Medical Image Segmentation11 May 2026
- 2026Attention Is not Everything: Efficient Alternatives for Vision19 Apr 2026
- 2026Probing Intrinsic Medical Task Relationships: A Contrastive Learning Perspective7 Apr 2026
- 2026UCell: rethinking generalizability and scaling of bio-medical vision models31 Mar 2026
- 2026Personalized Cell Segmentation: Benchmark and Framework for Reference-Guided Cell Type Segmentation15 Mar 2026
- 2026Cell Behavior Video Classification Challenge, a benchmark for computer vision methods in time-lapse microscopy15 Jan 2026
- 2025Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimization2 Dec 2025
- 2025SAM3-Adapter: Efficient Adaptation of Segment Anything 3 for Camouflage Object Segmentation, Shadow Detection, and Medical Image Segmentation24 Nov 2025
27 more
- 2025Data Efficiency and Transfer Robustness in Biomedical Image Segmentation: A Study of Redundancy and Forgetting with Cellpose6 Nov 2025
- 2025NOA: a versatile, extensible tool for AI-based organoid analysis3 Nov 2025
- 2025Enhancing Feature Fusion of U-like Networks with Dynamic Skip Connections18 Sep 2025
- 2025SEMA: a Scalable and Efficient Mamba like Attention via Token Localization and Averaging10 Jun 2025
- 2025SAMJ: Fast Image Annotation on ImageJ/Fiji via Segment Anything Model3 Jun 2025
- 2025MedVKAN: Efficient Feature Extraction with Mamba and KAN for Medical Image Segmentation17 May 2025
- 2025Fast Sphericity and Roundness approximation in 2D and 3D using Local Thickness8 Apr 2025
- 2025PyUAT: Open-source Python framework for efficient and scalable cell tracking27 Mar 2025
- 2025From Claims to Evidence: A Unified Framework and Critical Analysis of CNN vs. Transformer vs. Mamba in Medical Image Segmentation3 Mar 2025
- 2024CellSeg1: Robust Cell Segmentation with One Training Image2 Dec 2024
- 2024CellPilot: A unified approach to automatic and interactive segmentation in histopathology23 Nov 2024
- 2024TTT-Unet: Enhancing U-Net with Test-Time Training Layers for Biomedical Image Segmentation17 Sep 2024
- 2024LoG-VMamba: Local-Global Vision Mamba for Medical Image Segmentation26 Aug 2024
- 2024CHOTA: A Higher Order Accuracy Metric for Cell Tracking21 Aug 2024
- 2024Segment Anything in Medical Images and Videos: Benchmark and Deployment6 Aug 2024
- 2024Biomedical SAM 2: Segment Anything in Biomedical Images and Videos6 Aug 2024
- 2024HoloHisto: End-to-end Gigapixel WSI Segmentation with 4K Resolution Sequential Tokenization3 Jul 2024
- 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agent2 Jul 2024
- 2024xLSTM-UNet can be an Effective 2D & 3D Medical Image Segmentation Backbone with Vision-LSTM (ViL) better than its Mamba Counterpart1 Jul 2024
- 2024Multimodal Data Integration for Precision Oncology: Challenges and Future Directions28 Jun 2024
- 2024Vision Mamba: A Comprehensive Survey and Taxonomy7 May 2024
- 2024ViM-UNet: Vision Mamba for Biomedical Segmentation11 Apr 2024
- 2024Cell Graph Transformer for Nuclei Classification20 Feb 2024
- 2024UniCell: Universal Cell Nucleus Classification via Prompt Learning20 Feb 2024
- 2024Swin-UMamba: Mamba-based UNet with ImageNet-based pretraining5 Feb 2024
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation9 Jan 2024
- 2023Defining the boundaries: challenges and advances in identifying cells in microscopy images14 Nov 2023
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 419
- 2024Swin-UMamba: Mamba-based UNet with ImageNet-based pretrainingcited by 179
- 2024Vision Mamba: A Comprehensive Survey and Taxonomycited by 54
- 2024xLSTM-UNet can be an Effective 2D & 3D Medical Image Segmentation Backbone with Vision-LSTM (ViL) better than its Mamba Counterpartcited by 12
- 2024ViM-UNet: Vision Mamba for Biomedical Segmentationcited by 11
- 2024LoG-VMamba: Local-Global Vision Mamba for Medical Image Segmentationcited by 9
- 2025MedVKAN: Efficient Feature Extraction with Mamba and KAN for Medical Image Segmentationcited by 1
- 2025SEMA: a Scalable and Efficient Mamba like Attention via Token Localization and Averagingcited by 1
- 2025From Claims to Evidence: A Unified Framework and Critical Analysis of CNN vs. Transformer vs. Mamba in Medical Image Segmentationcited by 0
- 2026USEMA: a Scalable Efficient Mamba Like Attention for Medical Image Segmentationcited by 0
- 2026USEMA: a Scalable Efficient Mamba Like Attention for Medical Image Segmentation11 May 2026
- 2025SEMA: a Scalable and Efficient Mamba like Attention via Token Localization and Averaging10 Jun 2025
- 2025MedVKAN: Efficient Feature Extraction with Mamba and KAN for Medical Image Segmentation17 May 2025
- 2025From Claims to Evidence: A Unified Framework and Critical Analysis of CNN vs. Transformer vs. Mamba in Medical Image Segmentation3 Mar 2025
- 2024LoG-VMamba: Local-Global Vision Mamba for Medical Image Segmentation26 Aug 2024
- 2024xLSTM-UNet can be an Effective 2D & 3D Medical Image Segmentation Backbone with Vision-LSTM (ViL) better than its Mamba Counterpart1 Jul 2024
- 2024Vision Mamba: A Comprehensive Survey and Taxonomy7 May 2024
- 2024ViM-UNet: Vision Mamba for Biomedical Segmentation11 Apr 2024
- 2024Swin-UMamba: Mamba-based UNet with ImageNet-based pretraining5 Feb 2024
- 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation9 Jan 2024
- 2024MMedAgent: Learning to Use Medical Tools with Multi-modal Agentcited by 109
- 2024Segment Anything in Medical Images and Videos: Benchmark and Deploymentcited by 42
- 2024Biomedical SAM 2: Segment Anything in Biomedical Images and Videoscited by 14
- 2024Multimodal Data Integration for Precision Oncology: Challenges and Future Directionscited by 10
- 2024Cell Graph Transformer for Nuclei Classificationcited by 9
- 2024HoloHisto: End-to-end Gigapixel WSI Segmentation with 4K Resolution Sequential Tokenizationcited by 8
- 2025SAM3-Adapter: Efficient Adaptation of Segment Anything 3 for Camouflage Object Segmentation, Shadow Detection, and Medical Image Segmentationcited by 7
- 2024CellSeg1: Robust Cell Segmentation with One Training Imagecited by 6
- 2024TTT-Unet: Enhancing U-Net with Test-Time Training Layers for Biomedical Image Segmentationcited by 3
- 2025Enhancing Feature Fusion of U-like Networks with Dynamic Skip Connectionscited by 3
- 2023Defining the boundaries: challenges and advances in identifying cells in microscopy imagescited by 2
- 2024UniCell: Universal Cell Nucleus Classification via Prompt Learningcited by 1
- 2025PyUAT: Open-source Python framework for efficient and scalable cell trackingcited by 1
12 most cited of 28 All 28 (JSON)
- 2026QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation29 Aug 2026
- 2026HASSL: Hierarchy-Aware Self-Supervised Learning Framework for Single Cell Microscopy5 Jul 2026
- 2026MedCAGD: Context-Aware Gated Decoder for Efficient Medical Image Segmentation1 Jul 2026
- 2026MicroscopyMatching: Towards a Ready-to-use Framework for Microscopy Image Analysis in Diverse Conditions14 May 2026
- 2026Attention Is not Everything: Efficient Alternatives for Vision19 Apr 2026
- 2026Probing Intrinsic Medical Task Relationships: A Contrastive Learning Perspective7 Apr 2026
- 2026UCell: rethinking generalizability and scaling of bio-medical vision models31 Mar 2026
- 2026Personalized Cell Segmentation: Benchmark and Framework for Reference-Guided Cell Type Segmentation15 Mar 2026
- 2026Cell Behavior Video Classification Challenge, a benchmark for computer vision methods in time-lapse microscopy15 Jan 2026
- 2025Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimization2 Dec 2025
- 2025SAM3-Adapter: Efficient Adaptation of Segment Anything 3 for Camouflage Object Segmentation, Shadow Detection, and Medical Image Segmentation24 Nov 2025
- 2025Data Efficiency and Transfer Robustness in Biomedical Image Segmentation: A Study of Redundancy and Forgetting with Cellpose6 Nov 2025
12 newest of 28 All 28 (JSON)