Vox2Cortex: Fast Explicit Reconstruction of Cortical Surfaces from 3D MRI Scans with Geometric Deep Neural Networks
Not on the map. Why?
Abstract (arXiv)
The reconstruction of cortical surfaces from brain magnetic resonance imaging (MRI) scans is essential for quantitative analyses of cortical thickness and sulcal morphology. Although traditional and deep learning-based algorithmic pipelines exist for this purpose, they have two major drawbacks: lengthy runtimes of multiple hours (traditional) or intricate post-processing, such as mesh extraction and topology correction (deep learning-based). In this work, we address both of these issues and propose Vox2Cortex, a deep learning-based algorithm that directly yields topologically correct, three-dimensional meshes of the boundaries of the cortex. Vox2Cortex leverages convolutional and graph convolutional neural networks to deform an initial template to the densely folded geometry of the cortex represented by an input MRI scan. We show in extensive experiments on three brain MRI datasets that our meshes are as accurate as the ones reconstructed by state-of-the-art methods in the field, without the need for time- and resource-intensive post-processing. To accurately reconstruct the tightly folded cortex, we work with meshes containing about 168,000 vertices at test time, scaling deep explicit reconstruction methods to a new level.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 28 of its 63 references that are in the map. First posted on arXiv 17 Mar 2022.
Builds on
28 of 63 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
16 more
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2017Road Extraction by Deep Residual U-Netcited by 333
- 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
- 2019FastSurfer -- A fast and accurate deep learning based neuroimaging pipelinecited by 110
- 2019Pixel2Mesh++: Multi-View 3D Mesh Generation via Deformationcited by 103
- 20193DN: 3D Deformation Networkcited by 60
- 2020Neural Mesh Flow: 3D Manifold Mesh Generation via Diffeomorphic Flowscited by 60
- 2019Voxel2Mesh: 3D Mesh Model Generation from Volumetric Datacited by 52
- 20193D Whole Brain Segmentation using Spatially Localized Atlas Network Tilescited by 50
- 2021A Deep-Learning Approach For Direct Whole-Heart Mesh Reconstructioncited by 47
- 2018QuickNAT: A Fully Convolutional Network for Quick and Accurate Segmentation of Neuroanatomycited by 37
- 2019GEOMetrics: Exploiting Geometric Structure for Graph-Encoded Objectscited by 27
- 2020DeepCSR: A 3D Deep Learning Approach for Cortical Surface Reconstructioncited by 26
- 2021PialNN: A Fast Deep Learning Framework for Cortical Pial Surface Reconstructioncited by 13
- 2021Whole Heart Mesh Generation For Image-Based Computational Simulations By Learning Free-From Deformationscited by 12
- 2020Recalibrating 3D ConvNets with Project & Excitecited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 10; 2024: 3; 2025: 12; 2026: 1.
27 papers.
Sort:
- 2023S3M: Scalable Statistical Shape Modeling through Unsupervised Correspondencescited by 11
- 2023NexToU: Efficient Topology-Aware U-Net for Medical Image Segmentationcited by 9
- 2023Diffeomorphic Mesh Deformation via Efficient Optimal Transport for Cortical Surface Reconstructioncited by 7
- 2023Cortical analysis of heterogeneous clinical brain MRI scans for large-scale neuroimaging studiescited by 6
- 2024Recon-all-clinical: Cortical surface reconstruction and analysis of heterogeneous clinical brain MRIcited by 6
- 2023Abdominal organ segmentation via deep diffeomorphic mesh deformationscited by 4
- 2025From Pixels to Polygons: A Survey of Deep Learning Approaches for Medical Image-to-Mesh Reconstructioncited by 4
- 2025DeformCL: Learning Deformable Centerline Representation for Vessel Extraction in 3D Medical Imagecited by 4
- 2025End-to-End 4D Heart Mesh Recovery Across Full-Stack and Sparse Cardiac MRIcited by 4
- 2023Hybrid-CSR: Coupling Explicit and Implicit Shape Representation for Cortical Surface Reconstructioncited by 3
- 2023SurfNN: Joint Reconstruction of Multiple Cortical Surfaces from Magnetic Resonance Imagescited by 2
- 2025AI-Powered Automated Model Construction for Patient-Specific CFD Simulations of Aortic Flowscited by 2
15 more
- 2025From Low Field to High Value: Robust Cortical Mapping from Low-Field MRIcited by 2
- 2022Joint Reconstruction and Parcellation of Cortical Surfacescited by 1
- 2023Spatial Correspondence between Graph Neural Network-Segmented Imagescited by 1
- 2023What You See Is What You Detect: Towards better Object Densification in 3D detectioncited by 1
- 2025Reconsider the Template Mesh in Deep Learning-based Mesh Reconstructioncited by 1
- 2025PrIntMesh: Precise Intersection Surfaces for 3D Organ Mesh Reconstructioncited by 1
- 2023Reconstruction of Cortical Surfaces with Spherical Topology from Infant Brain MRI via Recurrent Deformation Learningcited by 0
- 2024V2C-Long: Longitudinal Cortex Reconstruction with Spatiotemporal Correspondencecited by 0
- 2024Medical Visual Prompting (MVP): A Unified Framework for Versatile and High-Quality Medical Image Segmentationcited by 0
- 2025UNSURF: Uncertainty Quantification for Cortical Surface Reconstruction of Clinical Brain MRIscited by 0
- 2025SimCortex: Collision-free Simultaneous Cortical Surfaces Reconstructioncited by 0
- 2025End-to-End Learning of Multi-Organ Implicit Surfaces from 3D Medical Imaging Datacited by 0
- 2025Template-Based Cortical Surface Reconstruction with Minimal Energy Deformationcited by 0
- 2025Unified Brain Surface and Volume Registrationcited by 0
- 2026KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networkscited by 0
- 2026KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networks9 Feb 2026
- 2025Unified Brain Surface and Volume Registration22 Dec 2025
- 2025PrIntMesh: Precise Intersection Surfaces for 3D Organ Mesh Reconstruction20 Nov 2025
- 2025Template-Based Cortical Surface Reconstruction with Minimal Energy Deformation18 Sep 2025
- 2025End-to-End 4D Heart Mesh Recovery Across Full-Stack and Sparse Cardiac MRI15 Sep 2025
- 2025End-to-End Learning of Multi-Organ Implicit Surfaces from 3D Medical Imaging Data15 Sep 2025
- 2025SimCortex: Collision-free Simultaneous Cortical Surfaces Reconstruction9 Jul 2025
- 2025DeformCL: Learning Deformable Centerline Representation for Vessel Extraction in 3D Medical Image6 Jun 2025
- 2025UNSURF: Uncertainty Quantification for Cortical Surface Reconstruction of Clinical Brain MRIs31 May 2025
- 2025Reconsider the Template Mesh in Deep Learning-based Mesh Reconstruction21 May 2025
- 2025From Low Field to High Value: Robust Cortical Mapping from Low-Field MRI18 May 2025
- 2025From Pixels to Polygons: A Survey of Deep Learning Approaches for Medical Image-to-Mesh Reconstruction6 May 2025
15 more
- 2025AI-Powered Automated Model Construction for Patient-Specific CFD Simulations of Aortic Flows16 Mar 2025
- 2024Recon-all-clinical: Cortical surface reconstruction and analysis of heterogeneous clinical brain MRI5 Sep 2024
- 2024Medical Visual Prompting (MVP): A Unified Framework for Versatile and High-Quality Medical Image Segmentation1 Apr 2024
- 2024V2C-Long: Longitudinal Cortex Reconstruction with Spatiotemporal Correspondence27 Feb 2024
- 2023Reconstruction of Cortical Surfaces with Spherical Topology from Infant Brain MRI via Recurrent Deformation Learning10 Dec 2023
- 2023What You See Is What You Detect: Towards better Object Densification in 3D detection27 Oct 2023
- 2023Hybrid-CSR: Coupling Explicit and Implicit Shape Representation for Cortical Surface Reconstruction23 Jul 2023
- 2023Abdominal organ segmentation via deep diffeomorphic mesh deformations27 Jun 2023
- 2023Diffeomorphic Mesh Deformation via Efficient Optimal Transport for Cortical Surface Reconstruction27 May 2023
- 2023NexToU: Efficient Topology-Aware U-Net for Medical Image Segmentation25 May 2023
- 2023Cortical analysis of heterogeneous clinical brain MRI scans for large-scale neuroimaging studies2 May 2023
- 2023S3M: Scalable Statistical Shape Modeling through Unsupervised Correspondences15 Apr 2023
- 2023Spatial Correspondence between Graph Neural Network-Segmented Images12 Mar 2023
- 2023SurfNN: Joint Reconstruction of Multiple Cortical Surfaces from Magnetic Resonance Images6 Mar 2023
- 2022Joint Reconstruction and Parcellation of Cortical Surfaces19 Sep 2022
- 2023S3M: Scalable Statistical Shape Modeling through Unsupervised Correspondencescited by 11
- 2023NexToU: Efficient Topology-Aware U-Net for Medical Image Segmentationcited by 9
- 2023Diffeomorphic Mesh Deformation via Efficient Optimal Transport for Cortical Surface Reconstructioncited by 7
- 2023Cortical analysis of heterogeneous clinical brain MRI scans for large-scale neuroimaging studiescited by 6
- 2024Recon-all-clinical: Cortical surface reconstruction and analysis of heterogeneous clinical brain MRIcited by 6
- 2023Abdominal organ segmentation via deep diffeomorphic mesh deformationscited by 4
- 2025From Pixels to Polygons: A Survey of Deep Learning Approaches for Medical Image-to-Mesh Reconstructioncited by 4
- 2025DeformCL: Learning Deformable Centerline Representation for Vessel Extraction in 3D Medical Imagecited by 4
- 2025End-to-End 4D Heart Mesh Recovery Across Full-Stack and Sparse Cardiac MRIcited by 4
- 2023Hybrid-CSR: Coupling Explicit and Implicit Shape Representation for Cortical Surface Reconstructioncited by 3
- 2023SurfNN: Joint Reconstruction of Multiple Cortical Surfaces from Magnetic Resonance Imagescited by 2
- 2025AI-Powered Automated Model Construction for Patient-Specific CFD Simulations of Aortic Flowscited by 2
12 most cited of 27 All 27 (JSON)
- 2026KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networks9 Feb 2026
- 2025Unified Brain Surface and Volume Registration22 Dec 2025
- 2025PrIntMesh: Precise Intersection Surfaces for 3D Organ Mesh Reconstruction20 Nov 2025
- 2025Template-Based Cortical Surface Reconstruction with Minimal Energy Deformation18 Sep 2025
- 2025End-to-End 4D Heart Mesh Recovery Across Full-Stack and Sparse Cardiac MRI15 Sep 2025
- 2025End-to-End Learning of Multi-Organ Implicit Surfaces from 3D Medical Imaging Data15 Sep 2025
- 2025SimCortex: Collision-free Simultaneous Cortical Surfaces Reconstruction9 Jul 2025
- 2025DeformCL: Learning Deformable Centerline Representation for Vessel Extraction in 3D Medical Image6 Jun 2025
- 2025UNSURF: Uncertainty Quantification for Cortical Surface Reconstruction of Clinical Brain MRIs31 May 2025
- 2025Reconsider the Template Mesh in Deep Learning-based Mesh Reconstruction21 May 2025
- 2025From Low Field to High Value: Robust Cortical Mapping from Low-Field MRI18 May 2025
- 2025From Pixels to Polygons: A Survey of Deep Learning Approaches for Medical Image-to-Mesh Reconstruction6 May 2025
12 newest of 27 All 27 (JSON)