NeuroSeg Meets DINOv3: Transferring 2D Self-Supervised Visual Priors to 3D Neuron Segmentation via DINOv3 Initialization
Not on the map. Why?
Abstract (arXiv)
2D visual foundation models, such as DINOv3, a self-supervised model trained on large-scale natural images, have demonstrated strong zero-shot generalization, capturing both rich global context and fine-grained structural cues. However, an analogous 3D foundation model for downstream volumetric neuroimaging remains lacking, largely due to the challenges of 3D image acquisition and the scarcity of high-quality annotations. To address this gap, we propose to adapt the 2D visual representations learned by DINOv3 to a 3D biomedical segmentation model, enabling more data-efficient and morphologically faithful neuronal reconstruction. Specifically, we design an inflation-based adaptation strategy that inflates 2D filters into 3D operators, preserving semantic priors from DINOv3 while adapting to 3D neuronal volume patches. In addition, we introduce a topology-aware skeleton loss to explicitly enforce structural fidelity of graph-based neuronal arbor reconstruction. Extensive experiments on four neuronal imaging datasets, including two from BigNeuron and two public datasets, NeuroFly and CWMBS, demonstrate consistent improvements in reconstruction accuracy over SoTA methods, with average gains of 2.9% in Entire Structure Average, 2.8% in Different Structure Average, and 3.8% in Percentage of Different Structure. Code: https://github.com/yy0007/NeurINO.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 33 of its 78 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
33 of 78 references.
References · 33
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2025DINOv3cited by 1,297
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
- 2023BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairscited by 506
- 2020clDice -- A Novel Topology-Preserving Loss Function for Tubular Structure Segmentationcited by 286
- 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
- 2023Learning to Exploit Temporal Structure for Biomedical Vision-Language Processingcited by 210
- 2023BioCLIP: A Vision Foundation Model for the Tree of Lifecited by 159
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 156
- 2023MedKLIP: Medical Knowledge Enhanced Language-Image Pre-Training in Radiologycited by 149
- 2019A Topological Loss Function for Deep-Learning based Image Segmentation using Persistent Homologycited by 134
21 more
- 2017Batch Renormalization: Towards Reducing Minibatch Dependence in Batch-Normalized Modelscited by 127
- 2024Skeleton Recall Loss for Connectivity Conserving and Resource Efficient Segmentation of Thin Tubular Structurescited by 43
- 2023One-Prompt to Segment All Medical Imagescited by 38
- 2025MedDINOv3: How to adapt vision foundation models for medical image segmentation?cited by 25
- 2024Interpretable Bilingual Multimodal Large Language Model for Diverse Biomedical Taskscited by 24
- 2024Hybrid Mamba for Few-Shot Segmentationcited by 21
- 2024Rethinking Prior Information Generation with CLIP for Few-Shot Segmentationcited by 20
- 2023A skeletonization algorithm for gradient-based optimizationcited by 17
- 2025Dino U-Net: Exploiting High-Fidelity Dense Features from Foundation Models for Medical Image Segmentationcited by 16
- 2025Raptor: Scalable Train-Free Embeddings for 3D Medical Volumes Leveraging Pretrained 2D Foundation Modelscited by 13
- 2019Joint Segmentation and Path Classification of Curvilinear Structurescited by 12
- 2022DTU-Net: Learning Topological Similarity for Curvilinear Structure Segmentationcited by 12
- 2024PairAug: What Can Augmented Image-Text Pairs Do for Radiology?cited by 10
- 2022PointNeuron: 3D Neuron Reconstruction via Geometry and Topology Learning of Point Cloudscited by 6
- 2021Voxel-wise Cross-Volume Representation Learning for 3D Neuron Reconstructioncited by 4
- 2025Tiling artifacts and trade-offs of feature normalization in the segmentation of large biological imagescited by 4
- 2024Boosting 3D Neuron Segmentation with 2D Vision Transformer Pre-trained on Natural Imagescited by 2
- 2024NeuroFly: A framework for whole-brain single neuron reconstructioncited by 2
- 2025Improving Multimodal Brain Encoding Model with Dynamic Subject-awareness Routingcited by 2
- 2024DINeuro: Distilling Knowledge from 2D Natural Images via Deformable Tubular Transferring Strategy for 3D Neuron Reconstructioncited by 1
- 2025DualFete: Revisiting Teacher-Student Interactions from a Feedback Perspective for Semi-supervised Medical Image Segmentationcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.