Superhuman Accuracy on the SNEMI3D Connectomics Challenge
Not on the map. Why?
Abstract (arXiv)
For the past decade, convolutional networks have been used for 3D reconstruction of neurons from electron microscopic (EM) brain images. Recent years have seen great improvements in accuracy, as evidenced by submissions to the SNEMI3D benchmark challenge. Here we report the first submission to surpass the estimate of human accuracy provided by the SNEMI3D leaderboard. A variant of 3D U-Net is trained on a primary task of predicting affinities between nearest neighbor voxels, and an auxiliary task of predicting long-range affinities. The training data is augmented by simulated image defects. The nearest neighbor affinities are used to create an oversegmentation, and then supervoxels are greedily agglomerated based on mean affinity. The resulting SNEMI3D score exceeds the estimate of human accuracy by a large margin. While one should be cautious about extrapolating from the SNEMI3D benchmark to real-world accuracy of large-scale neural circuit reconstruction, our result inspires optimism that the goal of full automation may be realizable in the future.
Key facts. Cited by 64 papers in the map (data through 14 Oct 2026). First posted on arXiv 31 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 10; 2023: 8; 2024: 11; 2025: 10; 2026: 8.
64 papers.
Sort:
By area:
- 2022Harmonizing the object recognition strategies of deep neural networks with humanscited by 59
- 2021Deep Implicit Statistical Shape Models for 3D Medical Image Delineationcited by 26
- 2023Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learningcited by 19
- 2023Learning Multiscale Consistency for Self-supervised Electron Microscopy Instance Segmentationcited by 16
- 2024The 3D-PC: a benchmark for visual perspective taking in humans and machinescited by 16
- 2024Understanding Visual Feature Reliance through the Lens of Complexitycited by 15
- 2024Deep Rib Fracture Instance Segmentation and Classification from CT on the RibFrac Challengecited by 14
- 2022Deep Lake: a Lakehouse for Deep Learningcited by 13
- 2021NucMM Dataset: 3D Neuronal Nuclei Instance Segmentation at Sub-Cubic Millimeter Scalecited by 12
- 2021AxonEM Dataset: 3D Axon Instance Segmentation of Brain Cortical Regionscited by 11
- 2021Sparse Object-level Supervision for Instance Segmentation with Pixel Embeddingscited by 10
- 2021Advanced Deep Networks for 3D Mitochondria Instance Segmentationcited by 8
38 more
- 2022An Analysis on Ensemble Learning optimized Medical Image Classification with Deep Convolutional Neural Networkscited by 8
- 2024GOV-NeSF: Generalizable Open-Vocabulary Neural Semantic Fieldscited by 8
- 2021How Shift Equivariance Impacts Metric Learning for Instance Segmentationcited by 7
- 2023MTNeuro: A Benchmark for Evaluating Representations of Brain Structure Across Multiple Levels of Abstractioncited by 7
- 2024TokenUnify: Scaling Up Autoregressive Pretraining for Neuron Segmentationcited by 7
- 2025Does DINOv3 Set a New Medical Vision Standard? Benchmarking 2D and 3D Classification, Segmentation, and Registrationcited by 7
- 2022Segmentation in large-scale cellular electron microscopy with deep learning: A literature surveycited by 6
- 2023Self-supervised learning via inter-modal reconstruction and feature projection networks for label-efficient 3D-to-2D segmentationcited by 5
- 2021Automatic Volumetric Segmentation of Additive Manufacturing Defects with 3D U-Netcited by 4
- 2022Asymmetry Disentanglement Network for Interpretable Acute Ischemic Stroke Infarct Segmentation in Non-Contrast CT Scanscited by 4
- 2024Learning Multimodal Volumetric Features for Large-Scale Neuron Tracingcited by 4
- 2024HResFormer: Hybrid Residual Transformer for Volumetric Medical Image Segmentationcited by 4
- 2025H3DE-Net: Efficient and Accurate 3D Landmark Detection in Medical Imagingcited by 4
- 2021Consistent Recurrent Neural Networks for 3D Neuron Segmentationcited by 3
- 2021Voxel-level Siamese Representation Learning for Abdominal Multi-Organ Segmentationcited by 3
- 2021PyTorch Connectomics: A Scalable and Flexible Segmentation Framework for EM Connectomicscited by 3
- 2022Instance Segmentation of Unlabeled Modalities via Cyclic Segmentation GANcited by 3
- 2022Scan2Part: Fine-grained and Hierarchical Part-level Understanding of Real-World 3D Scanscited by 3
- 2022Mixed Supervision of Histopathology Improves Prostate Cancer Classification from MRIcited by 3
- 2023AxonCallosumEM Dataset: Axon Semantic Segmentation of Whole Corpus Callosum cross section from EM Imagescited by 3
- 2024Deep Multimodal Fusion of Data with Heterogeneous Dimensionality via Projective Networkscited by 3
- 2024ShapeMamba-EM: Fine-Tuning Foundation Model with Local Shape Descriptors and Mamba Blocks for 3D EM Image Segmentationcited by 3
- 2021Contrastive Learning for Mitochondria Segmentationcited by 2
- 2021Sub-cortical structure segmentation database for young populationcited by 2
- 2021PATO: Producibility-Aware Topology Optimization using Deep Learning for Metal Additive Manufacturingcited by 2
- 2022MISm: A Medical Image Segmentation Metric for Evaluation of weak labeled Datacited by 2
- 20233D Mitochondria Instance Segmentation with Spatio-Temporal Transformerscited by 2
- 2023Domain Adaptive Synapse Detection with Weak Point Annotationscited by 2
- 2021Bridging the Gap: Point Clouds for Merging Neurons in Connectomicscited by 1
- 2022DeepSTI: Towards Tensor Reconstruction using Fewer Orientations in Susceptibility Tensor Imagingcited by 1
- 2023The XPRESS Challenge: Xray Projectomic Reconstruction -- Extracting Segmentation with Skeletonscited by 1
- 2024DaCapo: a modular deep learning framework for scalable 3D image segmentationcited by 1
- 2024Efficient Slice Anomaly Detection Network for 3D Brain MRI Volumecited by 1
- 2025A Novel Convolutional-Free Method for 3D Medical Imaging Segmentationcited by 1
- 2025Dual form Complementary Masking for Domain-Adaptive Image Segmentationcited by 1
- 2025Deep Biomechanically-Guided Interpolation for Keypoint-Based Brain Shift Registrationcited by 1
- 2025Fast 3D Surrogate Modeling for Data Center Thermal Managementcited by 1
- 2025FGNet: Leveraging Feature-Guided Attention to Refine SAM2 for 3D EM Neuron Segmentationcited by 1
50 most cited of 64 All 64 (JSON)
- 2026Benchmarking Vision-Language Models on Synapse Detection and Proofreading in Connectomics29 Sep 2026
- 2026SomaNet: Weakly Supervised Learning for Instance Soma Segmentation in 3D Electron Microscopy with Partial Annotations19 Sep 2026
- 2026Catena: A Comprehensive Software Suite for Large-Scale Connectomics18 Sep 2026
- 2026Probe-EM: Targeted Neuron Tracing via Training-Free Semantic Verification6 Jul 2026
- 2026DeCoDrift: Stabilizing Decoder Coupling in Closed-Loop Foundation Segmentation25 May 2026
- 2026A Fast and Generic Energy-Shifting Transformer for Hybrid Monte Carlo Radiotherapy Calculation10 Apr 2026
- 2026NeuroMamba: Multi-Perspective Feature Interaction with Visual Mamba for Neuron Segmentation22 Jan 2026
- 2026Diffusion Model-Based Data Augmentation for Enhanced Neuron Segmentation22 Jan 2026
- 2025FGNet: Leveraging Feature-Guided Attention to Refine SAM2 for 3D EM Neuron Segmentation17 Nov 2025
- 2025Fast 3D Surrogate Modeling for Data Center Thermal Management13 Nov 2025
- 2025Towards Generalized Synapse Detection Across Invertebrate Species21 Sep 2025
- 2025Does DINOv3 Set a New Medical Vision Standard? Benchmarking 2D and 3D Classification, Segmentation, and Registration8 Sep 2025
38 more
- 2025Deep Biomechanically-Guided Interpolation for Keypoint-Based Brain Shift Registration19 Aug 2025
- 2025Dual form Complementary Masking for Domain-Adaptive Image Segmentation16 Jul 2025
- 2025NeuroADDA: Active Discriminative Domain Adaptation in Connectomic8 Mar 2025
- 2025Unsupervised Source-Free Ranking of Biomedical Segmentation Models Under Distribution Shift1 Mar 2025
- 2025H3DE-Net: Efficient and Accurate 3D Landmark Detection in Medical Imaging20 Feb 2025
- 2025A Novel Convolutional-Free Method for 3D Medical Imaging Segmentation8 Feb 2025
- 2024HResFormer: Hybrid Residual Transformer for Volumetric Medical Image Segmentation16 Dec 2024
- 2024Efficient Slice Anomaly Detection Network for 3D Brain MRI Volume28 Aug 2024
- 2024ShapeMamba-EM: Fine-Tuning Foundation Model with Local Shape Descriptors and Mamba Blocks for 3D EM Image Segmentation26 Aug 2024
- 2024DaCapo: a modular deep learning framework for scalable 3D image segmentation5 Aug 2024
- 2024Understanding Visual Feature Reliance through the Lens of Complexity8 Jul 2024
- 2024The 3D-PC: a benchmark for visual perspective taking in humans and machines6 Jun 2024
- 2024TokenUnify: Scaling Up Autoregressive Pretraining for Neuron Segmentation27 May 2024
- 2024GOV-NeSF: Generalizable Open-Vocabulary Neural Semantic Fields1 Apr 2024
- 2024Deep Rib Fracture Instance Segmentation and Classification from CT on the RibFrac Challenge14 Feb 2024
- 2024Deep Multimodal Fusion of Data with Heterogeneous Dimensionality via Projective Networks2 Feb 2024
- 2024Learning Multimodal Volumetric Features for Large-Scale Neuron Tracing5 Jan 2024
- 2023Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learning6 Oct 2023
- 2023Domain Adaptive Synapse Detection with Weak Point Annotations31 Aug 2023
- 2023Learning Multiscale Consistency for Self-supervised Electron Microscopy Instance Segmentation19 Aug 2023
- 2023Self-supervised learning via inter-modal reconstruction and feature projection networks for label-efficient 3D-to-2D segmentation6 Jul 2023
- 2023AxonCallosumEM Dataset: Axon Semantic Segmentation of Whole Corpus Callosum cross section from EM Images5 Jul 2023
- 20233D Mitochondria Instance Segmentation with Spatio-Temporal Transformers21 Mar 2023
- 2023The XPRESS Challenge: Xray Projectomic Reconstruction -- Extracting Segmentation with Skeletons8 Feb 2023
- 2023MTNeuro: A Benchmark for Evaluating Representations of Brain Structure Across Multiple Levels of Abstraction1 Jan 2023
- 2022Mixed Supervision of Histopathology Improves Prostate Cancer Classification from MRI13 Dec 2022
- 2022Harmonizing the object recognition strategies of deep neural networks with humans8 Nov 2022
- 2022MISm: A Medical Image Segmentation Metric for Evaluation of weak labeled Data24 Oct 2022
- 2022Deep Lake: a Lakehouse for Deep Learning22 Sep 2022
- 2022DeepSTI: Towards Tensor Reconstruction using Fewer Orientations in Susceptibility Tensor Imaging9 Sep 2022
- 2022Asymmetry Disentanglement Network for Interpretable Acute Ischemic Stroke Infarct Segmentation in Non-Contrast CT Scans30 Jun 2022
- 2022Segmentation in large-scale cellular electron microscopy with deep learning: A literature survey14 Jun 2022
- 2022Scan2Part: Fine-grained and Hierarchical Part-level Understanding of Real-World 3D Scans6 Jun 2022
- 2022Instance Segmentation of Unlabeled Modalities via Cyclic Segmentation GAN6 Apr 2022
- 2022An Analysis on Ensemble Learning optimized Medical Image Classification with Deep Convolutional Neural Networks27 Jan 2022
- 2021PyTorch Connectomics: A Scalable and Flexible Segmentation Framework for EM Connectomics10 Dec 2021
- 2021PATO: Producibility-Aware Topology Optimization using Deep Learning for Metal Additive Manufacturing8 Dec 2021
- 2021Bridging the Gap: Point Clouds for Merging Neurons in Connectomics3 Dec 2021
50 newest of 64 All 64 (JSON)
- 2022Harmonizing the object recognition strategies of deep neural networks with humanscited by 59
- 2021Deep Implicit Statistical Shape Models for 3D Medical Image Delineationcited by 26
- 2023Self-Supervised Neuron Segmentation with Multi-Agent Reinforcement Learningcited by 19
- 2023Learning Multiscale Consistency for Self-supervised Electron Microscopy Instance Segmentationcited by 16
- 2024The 3D-PC: a benchmark for visual perspective taking in humans and machinescited by 16
- 2024Understanding Visual Feature Reliance through the Lens of Complexitycited by 15
- 2024Deep Rib Fracture Instance Segmentation and Classification from CT on the RibFrac Challengecited by 14
- 2022Deep Lake: a Lakehouse for Deep Learningcited by 13
- 2021NucMM Dataset: 3D Neuronal Nuclei Instance Segmentation at Sub-Cubic Millimeter Scalecited by 12
- 2021AxonEM Dataset: 3D Axon Instance Segmentation of Brain Cortical Regionscited by 11
- 2021Sparse Object-level Supervision for Instance Segmentation with Pixel Embeddingscited by 10
- 2021Advanced Deep Networks for 3D Mitochondria Instance Segmentationcited by 8
12 most cited of 59 All 59 (JSON)
- 2026SomaNet: Weakly Supervised Learning for Instance Soma Segmentation in 3D Electron Microscopy with Partial Annotations19 Sep 2026
- 2026Catena: A Comprehensive Software Suite for Large-Scale Connectomics18 Sep 2026
- 2026Probe-EM: Targeted Neuron Tracing via Training-Free Semantic Verification6 Jul 2026
- 2026DeCoDrift: Stabilizing Decoder Coupling in Closed-Loop Foundation Segmentation25 May 2026
- 2026A Fast and Generic Energy-Shifting Transformer for Hybrid Monte Carlo Radiotherapy Calculation10 Apr 2026
- 2025FGNet: Leveraging Feature-Guided Attention to Refine SAM2 for 3D EM Neuron Segmentation17 Nov 2025
- 2025Fast 3D Surrogate Modeling for Data Center Thermal Management13 Nov 2025
- 2025Towards Generalized Synapse Detection Across Invertebrate Species21 Sep 2025
- 2025Does DINOv3 Set a New Medical Vision Standard? Benchmarking 2D and 3D Classification, Segmentation, and Registration8 Sep 2025
- 2025Deep Biomechanically-Guided Interpolation for Keypoint-Based Brain Shift Registration19 Aug 2025
- 2025Dual form Complementary Masking for Domain-Adaptive Image Segmentation16 Jul 2025
- 2025NeuroADDA: Active Discriminative Domain Adaptation in Connectomic8 Mar 2025
12 newest of 59 All 59 (JSON)