Neural deformation fields for template-based reconstruction of cortical surfaces from MRI
Not on the map. Why?
Abstract (arXiv)
The reconstruction of cortical surfaces is a prerequisite for quantitative analyses of the cerebral cortex in magnetic resonance imaging (MRI). Existing segmentation-based methods separate the surface registration from the surface extraction, which is computationally inefficient and prone to distortions. We introduce Vox2Cortex-Flow (V2C-Flow), a deep mesh-deformation technique that learns a deformation field from a brain template to the cortical surfaces of an MRI scan. To this end, we present a geometric neural network that models the deformation-describing ordinary differential equation in a continuous manner. The network architecture comprises convolutional and graph-convolutional layers, which allows it to work with images and meshes at the same time. V2C-Flow is not only very fast, requiring less than two seconds to infer all four cortical surfaces, but also establishes vertex-wise correspondences to the template during reconstruction. In addition, V2C-Flow is the first approach for cortex reconstruction that models white matter and pial surfaces jointly, therefore avoiding intersections between them. Our comprehensive experiments on internal and external test data demonstrate that V2C-Flow results in cortical surfaces that are state-of-the-art in terms of accuracy. Moreover, we show that the established correspondences are more consistent than in FreeSurfer and that they can directly be utilized for cortex parcellation and group analyses of cortical thickness.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 21 of its 56 references that are in the map. First posted on arXiv 23 Jan 2024.
Builds on
21 of 56 references.
References · 21
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2018Weisfeiler and Leman Go Neural: Higher-order Graph Neural Networkscited by 878
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 2017Road Extraction by Deep Residual U-Netcited by 333
- 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
- 2014Hypercolumns for Object Segmentation and Fine-grained Localizationcited by 128
- 2019FastSurfer -- A fast and accurate deep learning based neuroimaging pipelinecited by 110
- 2020Neural Mesh Flow: 3D Manifold Mesh Generation via Diffeomorphic Flowscited by 60
- 2019Voxel2Mesh: 3D Mesh Model Generation from Volumetric Datacited by 52
9 more
- 20193D Whole Brain Segmentation using Spatially Localized Atlas Network Tilescited by 50
- 2021A Deep-Learning Approach For Direct Whole-Heart Mesh Reconstructioncited by 47
- 2018QuickNAT: A Fully Convolutional Network for Quick and Accurate Segmentation of Neuroanatomycited by 37
- 2019GEOMetrics: Exploiting Geometric Structure for Graph-Encoded Objectscited by 27
- 2017Automatic segmentation of MR brain images with a convolutional neural networkcited by 26
- 2017DeepNAT: Deep Convolutional Neural Network for Segmenting Neuroanatomycited by 25
- 2022CortexODE: Learning Cortical Surface Reconstruction by Neural ODEscited by 22
- 2021PialNN: A Fast Deep Learning Framework for Cortical Pial Surface Reconstructioncited by 13
- 2022CorticalFlow++: Boosting Cortical Surface Reconstruction Accuracy, Regularity, and Interoperabilitycited by 11
Built on by
Citing papers per year: 2024: 2; 2025: 6; 2026: 5.
13 papers.
Sort:
By area:
- 2025From Pixels to Polygons: A Survey of Deep Learning Approaches for Medical Image-to-Mesh Reconstructioncited by 4
- 2026Non-Rigid 3D Shape Correspondences: From Foundations to Open Challenges and Opportunitiescited by 4
- 2025MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imagingcited by 3
- 2024Individualized Mapping of Aberrant Cortical Thickness via Stochastic Cortical Self-Reconstructioncited by 1
- 2025A Comprehensive Survey on Magnetic Resonance Image Reconstructioncited by 1
- 2026Cortex-Grounded Diffusion Models for Brain Image Generationcited by 1
- 2024V2C-Long: Longitudinal Cortex Reconstruction with Spatiotemporal Correspondencecited by 0
- 2025End-to-end Cortical Surface Reconstruction from Clinical Magnetic Resonance Imagescited by 0
- 2025SimCortex: Collision-free Simultaneous Cortical Surfaces Reconstructioncited by 0
- 2025Template-Based Cortical Surface Reconstruction with Minimal Energy Deformationcited by 0
- 2026PAS-Mamba: Phase-Amplitude-Spatial State Space Model for MRI Reconstructioncited by 0
- 2026KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networkscited by 0
- 2026High-Fidelity 3D Geometric Reconstruction of Pelvic Organs from MRI: A Hybrid Deep Learning and Iterative Optimization Approach16 Jun 2026
- 2026Non-Rigid 3D Shape Correspondences: From Foundations to Open Challenges and Opportunities1 Apr 2026
- 2026KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networks9 Feb 2026
- 2026Cortex-Grounded Diffusion Models for Brain Image Generation27 Jan 2026
- 2026PAS-Mamba: Phase-Amplitude-Spatial State Space Model for MRI Reconstruction20 Jan 2026
- 2025MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imaging20 Sep 2025
- 2025Template-Based Cortical Surface Reconstruction with Minimal Energy Deformation18 Sep 2025
- 2025SimCortex: Collision-free Simultaneous Cortical Surfaces Reconstruction9 Jul 2025
- 2025End-to-end Cortical Surface Reconstruction from Clinical Magnetic Resonance Images20 May 2025
- 2025From Pixels to Polygons: A Survey of Deep Learning Approaches for Medical Image-to-Mesh Reconstruction6 May 2025
- 2025A Comprehensive Survey on Magnetic Resonance Image Reconstruction10 Mar 2025
- 2024Individualized Mapping of Aberrant Cortical Thickness via Stochastic Cortical Self-Reconstruction11 Mar 2024
1 more
- 2026Cortex-Grounded Diffusion Models for Brain Image Generation27 Jan 2026
- 2025From Pixels to Polygons: A Survey of Deep Learning Approaches for Medical Image-to-Mesh Reconstructioncited by 4
- 2026Non-Rigid 3D Shape Correspondences: From Foundations to Open Challenges and Opportunitiescited by 4
- 2025MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imagingcited by 3
- 2024Individualized Mapping of Aberrant Cortical Thickness via Stochastic Cortical Self-Reconstructioncited by 1
- 2025A Comprehensive Survey on Magnetic Resonance Image Reconstructioncited by 1
- 2024V2C-Long: Longitudinal Cortex Reconstruction with Spatiotemporal Correspondencecited by 0
- 2025End-to-end Cortical Surface Reconstruction from Clinical Magnetic Resonance Imagescited by 0
- 2025SimCortex: Collision-free Simultaneous Cortical Surfaces Reconstructioncited by 0
- 2025Template-Based Cortical Surface Reconstruction with Minimal Energy Deformationcited by 0
- 2026KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networkscited by 0
- 2026High-Fidelity 3D Geometric Reconstruction of Pelvic Organs from MRI: A Hybrid Deep Learning and Iterative Optimization Approachcited by 0
- 2026High-Fidelity 3D Geometric Reconstruction of Pelvic Organs from MRI: A Hybrid Deep Learning and Iterative Optimization Approach16 Jun 2026
- 2026Non-Rigid 3D Shape Correspondences: From Foundations to Open Challenges and Opportunities1 Apr 2026
- 2026KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networks9 Feb 2026
- 2025MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imaging20 Sep 2025
- 2025Template-Based Cortical Surface Reconstruction with Minimal Energy Deformation18 Sep 2025
- 2025SimCortex: Collision-free Simultaneous Cortical Surfaces Reconstruction9 Jul 2025
- 2025End-to-end Cortical Surface Reconstruction from Clinical Magnetic Resonance Images20 May 2025
- 2025From Pixels to Polygons: A Survey of Deep Learning Approaches for Medical Image-to-Mesh Reconstruction6 May 2025
- 2025A Comprehensive Survey on Magnetic Resonance Image Reconstruction10 Mar 2025
- 2024Individualized Mapping of Aberrant Cortical Thickness via Stochastic Cortical Self-Reconstruction11 Mar 2024
- 2024V2C-Long: Longitudinal Cortex Reconstruction with Spatiotemporal Correspondence27 Feb 2024