TailProp: content-adaptive light- and heavy-tailed propagation for vision
Not on the map. Why?
Abstract (arXiv)
Science-inspired vision models show that explicit propagation dynamics can provide structured and interpretable alternatives to conventional token mixing. Existing formulations, however, typically construct and adapt visual propagation within a particular dynamical family, while visual representations can require substantially different spatial interactions across samples, channels, and network stages. We explore cross-regime adaptive propagation and introduce TailProp, a hierarchical vision backbone built upon the Tail Propagation Operator (TPO). TPO uses Gaussian and Cauchy stable-process propagators as complementary bases with rapidly decaying and heavy-tailed spatial influence, and predicts a content-conditioned channel-wise coefficient to adaptively combine them. Because this coefficient is spatially shared, the two responses are fused directly in the DCT domain with a single DCT/IDCT pair, yielding O(N1.5) spatial mixing for square feature maps with N=HW and fixed channel width. Across image classification, object detection, semantic segmentation, robustness, and cross-backbone restoration, TailProp consistently outperforms matched propagation baselines; TailProp-B reaches 84.4% Top-1 accuracy on ImageNet-1K, 50.3/44.8 box/mask AP under the 3x Mask R-CNN schedule, and 50.8% mIoU on ADE20K. Controlled ablations further show that these gains are not explained by single-basis propagation, an additional same-family branch, or within-family adaptive order alone, supporting complementary two-basis propagation as an effective design principle for visual representation learning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 33 of its 46 references that are in the map. First posted on arXiv 10 Sep 2026.
Builds on
33 of 46 references.
References · 33
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2017Mask R-CNNcited by 7,277
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2022A ConvNet for the 2020scited by 3,579
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
21 more
- 2019Natural Adversarial Examplescited by 1,408
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
- 2018Unified Perceptual Parsing for Scene Understandingcited by 1,271
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,013
- 2024VMamba: Visual State Space Modelcited by 969
- 2021CSWin Transformer: A General Vision Transformer Backbone with Cross-Shaped Windowscited by 527
- 2022InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutionscited by 482
- 2021XCiT: Cross-Covariance Image Transformerscited by 338
- 2018Deep Learning in Spiking Neural Networkscited by 263
- 2024MambaVision: A Hybrid Mamba-Transformer Vision Backbonecited by 224
- 2022DaViT: Dual Attention Vision Transformerscited by 175
- 2024EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mambacited by 146
- 2024MambaOut: Do We Really Need Mamba for Vision?cited by 143
- 2021Encoding physics to learn reaction-diffusion processescited by 61
- 2022Guided Depth Super-Resolution by Deep Anisotropic Diffusioncited by 46
- 2024Building Vision Models upon Heat Conductioncited by 7
- 2026WaveFormer: Frequency-Time Decoupled Vision Modeling with Wave Equationcited by 5
- 2025Fractional neural attention for efficient multiscale sequence processingcited by 2
- 2024Efficient Visual Representation Learning with Heat Conduction Equationcited by 1
- 2025Learnable Fractional Reaction-Diffusion Dynamics for Under-Display ToF Imaging and Beyondcited by 1
Built on by
Not cited yet.