mlsanityData to 14 Oct 2026

Scale-Consistent State-Space Dynamics via Fractal of Stationary Transformations

arXiv 2601.19551 ↗First posted 27 Jan 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent deep learning models increasingly rely on depth without structural guarantees on the validity of intermediate representations, rendering early stopping and adaptive computation ill-posed. We address this limitation by formulating a structural requirement for state-space model's scale-consistent latent dynamics across iterative refinement, and derive Fractal of Stationary Transformations (FROST), which enforces a self-similar representation manifold through a fractal inductive bias. Under this geometry, intermediate states correspond to different resolutions of a shared representation, and we provide a geometric analysis establishing contraction and stable convergence across iterations. As a consequence of this scale-consistent structure, halting naturally admits a ranking-based formulation driven by intrinsic feature quality rather than extrinsic objectives. Controlled experiments on ImageNet-100 empirically verify the predicted scale-consistent behavior, showing that adaptive efficiency emerges from the aligned latent geometry.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 33 references that are in the map. First posted on arXiv 27 Jan 2026.

Builds on

27 of 33 references.

References · 27

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  4. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  5. 2020Scaling Laws for Neural Language Modelscited by 6,586
  6. 2018Neural Ordinary Differential Equationscited by 3,779
  7. 2022A ConvNet for the 2020scited by 3,579
  8. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  9. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
  10. 2018On the Spectral Bias of Neural Networkscited by 1,341
  11. 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
  12. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
15 more
  1. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  2. 2024VMamba: Visual State Space Modelcited by 969
  3. 2018Universal Transformerscited by 647
  4. 2019Deep Equilibrium Modelscited by 615
  5. 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 596
  6. 2018Do Better ImageNet Models Transfer Better?cited by 565
  7. 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
  8. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
  9. 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 393
  10. 2014Recurrent Models of Visual Attentioncited by 349
  11. 2017SkipNet: Learning Dynamic Routing in Convolutional Networkscited by 332
  12. 2024LayerSkip: Enabling Early Exit Inference and Self-Speculative Decodingcited by 307
  13. 2024Mixture-of-Depths: Dynamically allocating compute in transformer-based language modelscited by 258
  14. 2021PonderNet: Learning to Pondercited by 168
  15. 2015ReNet: A Recurrent Neural Network Based Alternative to Convolutional Networkscited by 24

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Geometric Wall: Manifold Structure Predicts Layerwise Sparse Autoencoder Scaling Laws
  2. 2024Towards a theory of learning dynamics in deep state space models
  3. 2026Geometry-aware similarity metrics for neural representations on Riemannian and statistical manifolds
  4. 2026Latent Object Permanence: Topological Phase Transitions, Free-Energy Principles, and Renormalization Group Flows in Deep Transformer Manifolds
  5. 2026When Geometry Aligns: Dihedral Hidden-State Transformations in UNet, ViT, and DiT Architectures
  6. 2026Geometric regularization of autoencoders via observed stochastic dynamics
  7. 2026Breaking the Geometric Bottleneck: Contrastive Expansion in Asymmetric Cross-Modal Distillation
  8. 2025FractalMamba++: Scaling Vision Mamba Across Resolutions via Hilbert Fractal Geometry