Scale-Consistent State-Space Dynamics via Fractal of Stationary Transformations
Not on the map. Why?
Abstract (arXiv)
Recent deep learning models increasingly rely on depth without structural guarantees on the validity of intermediate representations, rendering early stopping and adaptive computation ill-posed. We address this limitation by formulating a structural requirement for state-space model's scale-consistent latent dynamics across iterative refinement, and derive Fractal of Stationary Transformations (FROST), which enforces a self-similar representation manifold through a fractal inductive bias. Under this geometry, intermediate states correspond to different resolutions of a shared representation, and we provide a geometric analysis establishing contraction and stable convergence across iterations. As a consequence of this scale-consistent structure, halting naturally admits a ranking-based formulation driven by intrinsic feature quality rather than extrinsic objectives. Controlled experiments on ImageNet-100 empirically verify the predicted scale-consistent behavior, showing that adaptive efficiency emerges from the aligned latent geometry.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 33 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
27 of 33 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2022A ConvNet for the 2020scited by 3,579
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
15 more
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2024VMamba: Visual State Space Modelcited by 969
- 2018Universal Transformerscited by 647
- 2019Deep Equilibrium Modelscited by 615
- 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 596
- 2018Do Better ImageNet Models Transfer Better?cited by 565
- 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
- 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
- 2023Hyena Hierarchy: Towards Larger Convolutional Language Modelscited by 393
- 2014Recurrent Models of Visual Attentioncited by 349
- 2017SkipNet: Learning Dynamic Routing in Convolutional Networkscited by 332
- 2024LayerSkip: Enabling Early Exit Inference and Self-Speculative Decodingcited by 307
- 2024Mixture-of-Depths: Dynamically allocating compute in transformer-based language modelscited by 258
- 2021PonderNet: Learning to Pondercited by 168
- 2015ReNet: A Recurrent Neural Network Based Alternative to Convolutional Networkscited by 24
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026The Geometric Wall: Manifold Structure Predicts Layerwise Sparse Autoencoder Scaling Laws
- 2024Towards a theory of learning dynamics in deep state space models
- 2026Geometry-aware similarity metrics for neural representations on Riemannian and statistical manifolds
- 2026Latent Object Permanence: Topological Phase Transitions, Free-Energy Principles, and Renormalization Group Flows in Deep Transformer Manifolds
- 2026When Geometry Aligns: Dihedral Hidden-State Transformations in UNet, ViT, and DiT Architectures
- 2026Geometric regularization of autoencoders via observed stochastic dynamics
- 2026Breaking the Geometric Bottleneck: Contrastive Expansion in Asymmetric Cross-Modal Distillation
- 2025FractalMamba++: Scaling Vision Mamba Across Resolutions via Hilbert Fractal Geometry