mlsanityData to 7 Oct 2026

Arcee: Differentiable Recurrent State Chain for Generative Vision Modeling with Mamba SSMs

arXiv 2511.11243 ↗First posted 14 Nov 2025cs.CVcited by 0

On the map: State-space sequence models (S4, Mamba) → Vision Mamba backbones

Abstract (arXiv)

State-space models (SSMs), Mamba in particular, are increasingly adopted for long-context sequence modeling, providing linear-time aggregation via an input-dependent, causal selective-scan operation. Along this line, recent "Mamba-for-vision" variants largely explore multiple scan orders to relax strict causality for non-sequential signals (e.g., images). Rather than preserving cross-block memory, the conventional formulation of the selective-scan operation in Mamba reinitializes each block's state-space dynamics from zero, discarding the terminal state-space representation (SSR) from the previous block. Arcee, a cross-block recurrent state chain, reuses each block's terminal state-space representation as the initial condition for the next block. Handoff across blocks is constructed as a differentiable boundary map whose Jacobian enables end-to-end gradient flow across terminal boundaries. Key to practicality, Arcee is compatible with all prior "vision-mamba" variants, parameter-free, and incurs constant, negligible cost. As a modeling perspective, we view terminal SSR as a mild directional prior induced by a causal pass over the input, rather than an estimator of the non-sequential signal itself. To quantify the impact, for unconditional generation on CelebA-HQ (256×256) with Flow Matching, Arcee reduces FIDdownarrow from 82.81 to 15.33 (5.4× lower) on a single scan-order Zigzag Mamba baseline. Efficient CUDA kernels and training code will be released to support rigorous and reproducible research.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Vision Mamba backbones, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 31 of its 39 references that are in the map. First posted on arXiv 14 Nov 2025.

Builds on

31 of 39 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model17 Jan

Other references · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  5. 2022Scalable Diffusion Models with Transformerscited by 5,931
  6. 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
  7. 2022Flow Matching for Generative Modelingcited by 5,426
  8. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  9. 2013Auto-Encoding Variational Bayescited by 3,980
  10. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  11. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  12. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
18 more
  1. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  2. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  3. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  4. 2018Demystifying MMD GANscited by 1,268
  5. 2024VMamba: Visual State Space Modelcited by 955
  6. 2024SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformerscited by 707
  7. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 607
  8. 2022All are Worth Words: A ViT Backbone for Diffusion Modelscited by 498
  9. 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
  10. 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 412
  11. 2022Diagonal State Spaces are as Effective as Structured State Spacescited by 350
  12. 2024Flow Matching Guide and Codecited by 291
  13. 2023One Transformer Fits All Distributions in Multi-Modal Diffusion at Scalecited by 185
  14. 2024Swin-UMamba: Mamba-based UNet with ImageNet-based pretrainingcited by 179
  15. 2023SE(3)-Stochastic Flow Matching for Protein Backbone Generationcited by 147
  16. 2022How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projectionscited by 121
  17. 2024ZigMa: A DiT-style Zigzag Mamba Diffusion Modelcited by 84
  18. 2024MambaByte: Token-free Selective State Space Modelcited by 58

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025X-VMamba: Explainable Vision Mamba
  2. 2025Fast Vision Mamba: Pooling Spatial Dimensions for Accelerated Processing
  3. 2025Block-Biased Mamba for Long-Range Sequence Processing
  4. 2024LocalMamba: Visual State Space Model with Windowed Selective Scan
  5. 2025LBMamba: Locally Bi-directional Mamba
  6. 2024A Survey on Visual Mamba
  7. 2024Multi-Scale VMamba: Hierarchy in Hierarchy Visual State Space Model
  8. 2024VSSD: Vision Mamba with Non-Causal State Space Duality