mlsanityData to 14 Oct 2026

FractalMamba++: Scaling Vision Mamba Across Resolutions via Hilbert Fractal Geometry

arXiv 2505.14062 ↗First posted 20 May 2025cs.CVcited by 1

On the map: State-space sequence models (S4, Mamba) → Vision Mamba backbones

Abstract (arXiv)

Vision Mamba offers linear complexity for long visual sequences, yet its performance depends critically on how a two-dimensional patch grid is serialized into a one-dimensional state-space recurrence. Raster-style scans disrupt spatial continuity, and the mismatch between 2D locality and 1D state propagation becomes increasingly severe when the inference resolution grows beyond the training grid. This paper presents FractalMamba++, a resolution-scalable vision backbone organized around a single geometric principle: the recursive self-similar structure of the Hilbert curve determines how patches are serialized, where long-range state shortcuts are inserted, and how positional relations are encoded. First, Hilbert-curve-based Fractal Serialization preserves local 2D neighborhoods more faithfully than linear scans and provides consistent neighborhood statistics across resolutions. Second, the Fractal Hierarchy Skip Connection (FHSC) derives a compact set of deterministic state-injection routes from Hilbert recursion levels, mitigating long-sequence information fading without runtime search, hand-derived gradients, or dedicated CUDA kernels. Third, Fractal-Aware 2D Rotary Position Encoding (FA-RoPE) combines normalized 2D coordinates with a fractal hierarchy level so that feature interactions depend on actual spatial proximity and recursive structural role rather than serialized 1D distance. Extensive experiments on ImageNet-1K classification, COCO detection and instance segmentation, ADE20K semantic segmentation, and LEVIR-CD+ remote sensing change detection show that FractalMamba++ improves over existing Mamba-based vision backbones, especially under high-resolution inputs.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Vision Mamba backbones, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 50 of its 57 references that are in the map. First posted on arXiv 20 May 2025.

Builds on

50 of 57 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025DefMamba: Deformable Visual State Space Model8 Apr
  2. 2024Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusion19 Oct
  3. 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbone10 Jul
  4. 2024Demystify Mamba in Vision: A Linear Attention Perspective26 May
  5. 2024Mamba-R: Vision Mamba ALSO Needs Registers23 May
  6. 2024PlainMamba: Improving Non-Hierarchical Mamba in Visual Recognition26 Mar
  7. 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference21 Mar
  8. 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba15 Mar
  9. 2024LocalMamba: Visual State Space Model with Windowed Selective Scan14 Mar
  10. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model17 Jan

Other references · 40

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  6. 2023GPT-4 Technical Reportcited by 18,396
  7. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  8. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  9. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  10. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  11. 2023Segment Anythingcited by 8,234
  12. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
28 more
  1. 2017Mask R-CNNcited by 7,277
  2. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  3. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  4. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  7. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  8. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  9. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  10. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
  11. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  12. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
  13. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
  14. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,050
  15. 2024VMamba: Visual State Space Modelcited by 969
  16. 2020Designing Network Design Spacescited by 960
  17. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  18. 2022DeiT III: Revenge of the ViTcited by 419
  19. 2025MedVLM-R1: Incentivizing Medical Reasoning Capability of Vision-Language Models (VLMs) via Reinforcement Learningcited by 173
  20. 2024Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Expertscited by 108
  21. 2023Graph Foundation Models: Concepts, Opportunities and Challengescited by 103
  22. 2022Pyramid Grafting Network for One-Stage High Resolution Saliency Detectioncited by 63
  23. 2024Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Modelcited by 62
  24. 2022ResFormer: Scaling ViTs with Multi-Resolution Trainingcited by 34
  25. 2024Scalable Autoregressive Image Generation with Mambacited by 26
  26. 2025VARGPT-v1.1: Improve Visual Autoregressive Large Unified Model via Iterative Instruction Tuning and Reinforcement Learningcited by 21
  27. 2023Towards Training-free Open-world Segmentation via Image Prompt Foundation Modelscited by 15
  28. 2024GrootVL: Tree Topology is All You Need in State Space Modelcited by 13

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Scalable Visual State Space Model with Fractal Scanning
  2. 2026Partial Ring Scan: Revisiting Scan Order in Vision State Space Models
  3. 2026Spatial-Aware Reduction Framework: Towards Efficient and Faithful Visual State Space Models
  4. 2026SF-Mamba: Rethinking State Space Model for Vision
  5. 2025MambaScope: Coarse-to-Fine Scoping for Efficient Vision Mamba
  6. 2024V2M: Visual 2-Dimensional Mamba for Image Representation Learning
  7. 2025Fast Vision Mamba: Pooling Spatial Dimensions for Accelerated Processing
  8. 2024QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Model