GSToken: Geometry-Structured Gaussian Tokens for Compact 3D Medical Image Representation
Not on the map. Why?
Abstract (arXiv)
Effective segmentation of multi-modal MRI is central to improving neural network accuracy in brain tumor recognition. Existing methods typically compress 3D volumes into token sequences via fixed patch encoding or learned attention pooling (e.g., TokenLearner). However, these compression schemes discard explicit spatial shape information; the resulting tokens convey no notion of lesion morphology or spatial extent. Meanwhile, end-to-end evaluation entangles a tokenizer's information retention with the reconstruction capacity of the downstream decoder, and the lack of a unified capacity contract across methods makes performance differences difficult to attribute. In this paper, we introduce Gaussian tokens to multi-modal brain tumor segmentation for the first time: each token carries not only a semantic feature but also a learned 3D center, anisotropic scale, and orientation, endowing the representation with explicit geometric support at negligible parameter cost. We further propose a frozen-token utility evaluation protocol: the trained tokenizer is frozen, its output is cast into a fixed-capacity serialized contract, and a shared lightweight Transformer probe independently measures each tokenizer's retained information under strictly matched conditions. Multi-seed paired statistical testing shows that GSToken consistently and substantially outperforms capacity-matched adaptive baselines under frozen probing, with uniform advantages across all tumor sub-regions, surface, and distance metrics. These results demonstrate that explicitly encoding spatial geometry within tokens significantly improves the information density of volumetric representations, offering a new design principle for compact 3D medical image representation and downstream reading.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 28 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
23 of 28 references.
References · 23
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2017Neural Discrete Representation Learningcited by 4,712
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,435
11 more
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 959
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 864
- 2022Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizationscited by 363
- 2018nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentationcited by 291
- 2021TransBTS: Multimodal Brain Tumor Segmentation Using Transformercited by 265
- 2018Recurrent Residual Convolutional Neural Network based on U-Net (R2U-Net) for Medical Image Segmentationcited by 180
- 20223D UX-Net: A Large Kernel Volumetric ConvNet Modernizing Hierarchical Transformer for Medical Image Segmentationcited by 94
- 2021DiNTS: Differentiable Neural Network Topology Search for 3D Medical Image Segmentationcited by 48
- 2022Fetal Brain Tissue Annotation and Segmentation Challenge Resultscited by 20
- 2025GS-TransUNet: Integrated 2D Gaussian Splatting and Transformer UNet for Accurate Skin Lesion Analysiscited by 2
Built on by
Not cited yet.