mlsanityData to 14 Oct 2026

OCTOPUS: Enhancing the Spatial-Awareness of Vision SSMs with Multi-Dimensional Scans and Traversal Selection

arXiv 2602.00904 ↗First posted 31 Jan 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

State space models (SSMs) have recently emerged as an alternative to transformers due to their unique ability of modeling global relationships in text with linear complexity. However, their success in vision tasks has been limited due to their causal formulation, which is suitable for sequential text but detrimental in the spatial domain where causality breaks the inherent spatial relationships among pixels or patches. As a result, standard SSMs fail to capture local spatial coherence, often linking non-adjacent patches while ignoring neighboring ones that are visually correlated. To address these limitations, we introduce OCTOPUS , a novel architecture that preserves both global context and local spatial structure within images, while maintaining the linear complexity of SSMs. OCTOPUS performs discrete reoccurrence along eight principal orientations, going forward or backward in the horizontal, vertical, and diagonal directions, allowing effective information exchange across all spatially connected regions while maintaining independence among unrelated patches. This design enables multi-directional recurrence, capturing both global context and local spatial structure with SSM-level efficiency. In our classification and segmentation benchmarks, OCTOPUS demonstrates notable improvements in boundary preservation and region consistency, as evident from the segmentation results, while maintaining relatively better classification accuracy compared to existing V-SSM based models. These results suggest that OCTOPUS appears as a foundation method for multi-directional recurrence as a scalable and effective mechanism for building spatially aware and computationally efficient vision architectures.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 31 references that are in the map. First posted on arXiv 31 Jan 2026.

Builds on

25 of 31 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2017Squeeze-and-Excitation Networkscited by 4,789
  5. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  6. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  7. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  8. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  9. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,069
  10. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
  11. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  12. 2024VMamba: Visual State Space Modelcited by 969
13 more
  1. 2022Simplified State Space Layers for Sequence Modelingcited by 788
  2. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 608
  3. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
  4. 2021XCiT: Cross-Covariance Image Transformerscited by 338
  5. 2022Long Range Language Modeling via Gated State Spacescited by 265
  6. 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 236
  7. 2024Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Modelcited by 62
  8. 2023Structured State Space Models for Multiple Instance Learning in Digital Pathologycited by 41
  9. 20242DMamba: Efficient State Space Model for Image Representation with Applications on Giga-Pixel Whole Slide Image Classificationcited by 35
  10. 2024Rethinking Scanning Strategies with Vision Mamba in Semantic Segmentation of Remote Sensing Imagery: An Experimental Studycited by 24
  11. 2025Spectral Informed Mamba for Robust Point Cloud Processingcited by 10
  12. 2025Spectral State Space Model for Rotation-Invariant Visual Representation Learningcited by 4
  13. 2025NERVE: Neighbourhood & Entropy-guided Random-walk for training free open-Vocabulary sEgmentationcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Spatial-Mamba: Effective Visual State Space Models via Structure-aware State Fusion
  2. 2024Mamba2D: A Natively Multi-Dimensional State-Space Model for Vision Tasks
  3. 2026MFil-Mamba: Multi-Filter Scanning for Spatial Redundancy-Aware Visual State Space Models
  4. 2026Can Graphs Help Vision SSMs See Better?
  5. 2026A Controlled Benchmark of Visual State-Space Backbones with Domain-Shift and Boundary Analysis for Remote-Sensing Segmentation
  6. 2026Vision Non-Causal Trapezoidal Mamba: Eliminating Directional Scanning in Vision SSMs with Second-Order Dynamics
  7. 2025Stitch and Tell: A Structured Multimodal Data Augmentation Method for Spatial Understanding
  8. 2024Getting it Right: Improving Spatial Consistency in Text-to-Image Models