mlsanityData to 14 Oct 2026

An Enhanced Pyramid Feature Network Based on Long-Range Dependencies for Multi-Organ Medical Image Segmentation

arXiv 2509.24358 ↗First posted 29 Sep 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In the field of multi-organ medical image segmentation, recent methods frequently employ Transformers to capture long-range dependencies from image features. However, these methods overlook the high computational cost of Transformers and their deficiencies in extracting local detailed information. To address high computational costs and inadequate local detail information, we reassess the design of feature extraction modules and propose a new deep-learning network called LamFormer for fine-grained segmentation tasks across multiple organs. LamFormer is a novel U-shaped network that employs Linear Attention Mamba (LAM) in an enhanced pyramid encoder to capture multi-scale long-range dependencies. We construct the Parallel Hierarchical Feature Aggregation (PHFA) module to aggregate features from different layers of the encoder, narrowing the semantic gap among features while filtering information. Finally, we design the Reduced Transformer (RT), which utilizes a distinct computational approach to globally model up-sampled features. RRT enhances the extraction of detailed local information and improves the network's capability to capture long-range dependencies. LamFormer outperforms existing segmentation methods on seven complex and diverse datasets, demonstrating exceptional performance. Moreover, the proposed network achieves a balance between model performance and model complexity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 36 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

28 of 36 references.

References · 28

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
  6. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  7. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  8. 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
  9. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
  10. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  11. 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 419
  12. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 397
16 more
  1. 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 309
  2. 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentationcited by 287
  3. 2023LongNet: Scaling Transformers to 1,000,000,000 Tokenscited by 204
  4. 2022Medical Image Segmentation Review: The success of U-Netcited by 191
  5. 2024Swin-UMamba: Mamba-based UNet with ImageNet-based pretrainingcited by 179
  6. 2022DaViT: Dual Attention Vision Transformerscited by 175
  7. 2024Demystify Mamba in Vision: A Linear Attention Perspectivecited by 102
  8. 2019Evaluation of Algorithms for Multi-Modality Whole Heart Segmentation: An Open-Access Grand Challengecited by 100
  9. 2023InstructTTS: Modelling Expressive TTS in Discrete Latent Space with Natural Language Style Promptcited by 92
  10. 2024Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Modelcited by 62
  11. 2024Rethinking Abdominal Organ Segmentation (RAOS) in the clinical scenario: A robustness evaluation benchmark with challenging casescited by 19
  12. 2023DeViT: Decomposing Vision Transformers for Collaborative Inference in Edge Devicescited by 13
  13. 2023Efficient Long-Range Transformers: You Need to Attend More, but Not Necessarily at Every Layercited by 13
  14. 2023Longformer: Longitudinal Transformer for Alzheimer's Disease Classification with Structural MRIscited by 12
  15. 2021Deep adaptive fuzzy clustering for evolutionary unsupervised representation learningcited by 6
  16. 2023Attention-based Encoder-Decoder End-to-End Neural Diarization with Embedding Enhancercited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MambaCAFU: Hybrid Multi-Scale and Multi-Attention Model with Mamba-Based Fusion for Medical Image Segmentation
  2. 2026CS-MUNet: A Channel-Spatial Dual-Stream Mamba Network for Multi-Organ Segmentation
  3. 2025TCSAFormer: Efficient Vision Transformer with Token Compression and Sparse Attention for Medical Image Segmentation
  4. 2022MISSU: 3D Medical Image Segmentation via Self-distilling TransUNet
  5. 2025MambaVesselNet++: A Hybrid CNN-Mamba Architecture for Medical Image Segmentation
  6. 2024Attention-Mamba: A Mamba-Enhanced Multi-Scale Parallel Inference Network for Medical Image Segmentation
  7. 2025HyM-UNet: Synergizing Local Texture and Global Context via Hybrid CNN-Mamba Architecture for Medical Image Segmentation
  8. 2024EM-Net: Efficient Channel and Frequency Learning with Mamba for 3D Medical Image Segmentation