Hierarchical Mesh Transformers with Topology-Guided Pretraining for Morphometric Analysis of Brain Structures
Not on the map. Why?
Abstract (arXiv)
Representation learning on large-scale unstructured volumetric and surface meshes poses significant challenges in neuroimaging, especially when models must incorporate diverse vertex-level morphometric descriptors, such as cortical thickness, curvature, sulcal depth, and myelin content, which carry subtle disease-related signals. Current approaches either ignore these clinically informative features or support only a single mesh topology, restricting their use across imaging pipelines. We introduce a hierarchical transformer framework designed for heterogeneous mesh analysis that operates on spatially adaptive tree partitions constructed from simplicial complexes of arbitrary order. This design accommodates both volumetric and surface discretizations within a single architecture, enabling efficient multi-scale attention without topology-specific modifications. A feature projection module maps variable-length per-vertex clinical descriptors into the spatial hierarchy, separating geometric structure from feature dimensionality and allowing seamless integration of different neuroimaging feature sets. Self-supervised pretraining via masked reconstruction of both coordinates and morphometric channels on large unlabeled cohorts yields a transferable encoder backbone applicable to diverse downstream tasks and mesh modalities. We validate our approach on Alzheimer's disease classification and amyloid burden prediction using volumetric brain meshes from ADNI, as well as focal cortical dysplasia detection on cortical surface meshes from the MELD dataset, achieving state-of-the-art results across all benchmarks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 38 references that are in the map. First posted on arXiv 6 Apr 2026.
Builds on
25 of 38 references.
References · 25
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Graph Attention Networkscited by 8,923
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
- 2020Point Transformercited by 1,470
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,153
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
- 2021Conditional Positional Encodings for Vision Transformerscited by 406
13 more
- 2016OctNet: Learning Deep 3D Representations at High Resolutionscited by 342
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 264
- 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
- 2023DSVT: Dynamic Sparse Voxel Transformer with Rotated Setscited by 122
- 2023OctFormer: Octree-based Transformers for 3D Point Cloudscited by 109
- 2022Occupancy-MAE: Self-supervised Pre-training Large-scale LiDAR Point Clouds with Masked Occupancy Autoencoderscited by 58
- 2024OA-CNNs: Omni-Adaptive Sparse CNNs for 3D Semantic Segmentationcited by 44
- 2024NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fieldscited by 20
- 2023T-MAE: Temporal Masked Autoencoders for Point Cloud Representation Learningcited by 11
- 2023TetCNN: Convolutional Neural Networks on Tetrahedral Meshescited by 5
- 2024TTT-KD: Test-Time Training for 3D Semantic Segmentation through Knowledge Distillation from Foundation Modelscited by 5
- 2022Anisotropic Multi-Scale Graph Convolutional Network for Dense Shape Correspondencecited by 2
- 2024A Recipe for Geometry-Aware 3D Mesh Transformerscited by 1
Built on by
Not cited yet.