Attention-based Shape-Deformation Networks for Artifact-Free Geometry Reconstruction of Lumbar Spine from MR Images
Not on the map. Why?
Abstract (arXiv)
Lumbar disc degeneration, a progressive structural wear and tear of lumbar intervertebral disc, is regarded as an essential role on low back pain, a significant global health concern. Automated lumbar spine geometry reconstruction from MR images will enable fast measurement of medical parameters to evaluate the lumbar status, in order to determine a suitable treatment. Existing image segmentation-based techniques often generate erroneous segments or unstructured point clouds, unsuitable for medical parameter measurement. In this work, we present textitUNet-DeformSA and textitTransDeformer: novel attention-based deep neural networks that reconstruct the geometry of the lumbar spine with high spatial accuracy and mesh correspondence across patients, and we also present a variant of textitTransDeformer for error estimation. Specially, we devise new attention modules with a new attention formula, which integrate image features and tokenized contour features to predict the displacements of the points on a shape template without the need for image segmentation. The deformed template reveals the lumbar spine geometry in an image. Experiment results show that our networks generate artifact-free geometry outputs, and the variant of textitTransDeformer can predict the errors of a reconstructed geometry. Our code is available at https://github.com/linchenq/TransDeformer-Mesh.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 25 of its 53 references that are in the map. First posted on arXiv 30 Mar 2024.
Builds on
25 of 53 references.
References · 25
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,518
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,218
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
- 2021UNETR: Transformers for 3D Medical Image Segmentationcited by 954
- 2022Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Imagescited by 823
13 more
- 2020A Survey on Visual Transformercited by 653
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 583
- 2017Residual Gated Graph ConvNetscited by 341
- 2021Medical Transformer: Gated Axial-Attention for Medical Image Segmentationcited by 319
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2021UCTransNet: Rethinking the Skip Connections in U-Net from a Channel-wise Perspective with Transformercited by 197
- 2019MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentationcited by 195
- 2019Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfacescited by 186
- 2022UNeXt: MLP-based Rapid Medical Image Segmentation Networkcited by 185
- 2021UTNet: A Hybrid Transformer Architecture for Medical Image Segmentationcited by 116
- 2019Voxel2Mesh: 3D Mesh Model Generation from Volumetric Datacited by 52
- 2021A Deep-Learning Approach For Direct Whole-Heart Mesh Reconstructioncited by 47
- 2024SymTC: A Symbiotic Transformer-CNN Net for Instance Segmentation of Lumbar Spine MRIcited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Shape Deformation Networks for Automated Aortic Valve Finite Element Meshing from 3D CT Imagescited by 0
- 2026SpineReport: Automated 3D Quantification and Reporting of Lumbar Spine Degeneration on MRIcited by 0
- 2026High-Fidelity 3D Geometric Reconstruction of Pelvic Organs from MRI: A Hybrid Deep Learning and Iterative Optimization Approachcited by 0
- 2026High-Fidelity 3D Geometric Reconstruction of Pelvic Organs from MRI: A Hybrid Deep Learning and Iterative Optimization Approach16 Jun 2026
- 2026SpineReport: Automated 3D Quantification and Reporting of Lumbar Spine Degeneration on MRI8 Jun 2026
- 2025Shape Deformation Networks for Automated Aortic Valve Finite Element Meshing from 3D CT Images5 Nov 2025