DeepTraverse: A Depth-First Search Inspired Network for Algorithmic Visual Understanding
Not on the map. Why?
Abstract (arXiv)
Conventional vision backbones, despite their success, often construct features through a largely uniform cascade of operations, offering limited explicit pathways for adaptive, iterative refinement. This raises a compelling question: can principles from classical search algorithms instill a more algorithmic, structured, and logical processing flow within these networks, leading to representations built through more interpretable, perhaps reasoning-like decision processes? We introduce DeepTraverse, a novel vision architecture directly inspired by algorithmic search strategies, enabling it to learn features through a process of systematic elucidation and adaptive refinement distinct from conventional approaches. DeepTraverse operationalizes this via two key synergistic components: recursive exploration modules that methodically deepen feature analysis along promising representational paths with parameter sharing for efficiency, and adaptive calibration modules that dynamically adjust feature salience based on evolving global context. The resulting algorithmic interplay allows DeepTraverse to intelligently construct and refine feature patterns. Comprehensive evaluations across a diverse suite of image classification benchmarks show that DeepTraverse achieves highly competitive classification accuracy and robust feature discrimination, often outperforming conventional models with similar or larger parameter counts. Our work demonstrates that integrating such algorithmic priors provides a principled and effective strategy for building more efficient, performant, and structured vision backbones.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 60 references that are in the map. First posted on arXiv 11 Jun 2025.
Builds on
52 of 60 references.
References · 52
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2022A ConvNet for the 2020scited by 3,579
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2016Wide Residual Networkscited by 3,070
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
38 more
- 2019Searching for MobileNetV3cited by 1,994
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
- 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
- 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,136
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
- 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
- 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 569
- 2021LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inferencecited by 475
- 2022DeiT III: Revenge of the ViTcited by 419
- 2019GhostNet: More Features from Cheap Operationscited by 410
- 2021Bottleneck Transformers for Visual Recognitioncited by 364
- 2021XCiT: Cross-Covariance Image Transformerscited by 338
- 2022EfficientFormer: Vision Transformers at MobileNet Speedcited by 241
- 2021Mobile-Former: Bridging MobileNet and Transformercited by 235
- 2021Scaling Local Self-Attention for Parameter Efficient Visual Backbonescited by 220
- 2018Compositional Attention Networks for Machine Reasoningcited by 183
- 2022Separable Self-attention for Mobile Vision Transformerscited by 163
- 2019Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolutioncited by 140
- 2023Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networkscited by 130
- 2022QuadTree Attention for Vision Transformerscited by 129
- 2021SOFT: Softmax-free Transformer with Linear Complexitycited by 128
- 2021CycleMLP: A MLP-like Architecture for Dense Predictioncited by 126
- 2017CondenseNet: An Efficient DenseNet using Learned Group Convolutionscited by 122
- 2019Neural Execution of Graph Algorithmscited by 121
- 2022EdgeViTs: Competing Light-weight CNNs on Mobile Devices with Vision Transformerscited by 116
- 2021AS-MLP: An Axial Shifted MLP Architecture for Visioncited by 101
- 2021Are we ready for a new paradigm shift? A Survey on Visual Deep MLPcited by 63
- 2024Rewrite the Starscited by 55
- 2014Rigid-Motion Scattering for Texture Classificationcited by 52
- 2022LightViT: Towards Light-Weight Convolution-Free Vision Transformerscited by 40
- 2022When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanismcited by 30
- 2021MicroNet: Improving Image Recognition with Extremely Low FLOPscited by 26
- 2019HetConv: Heterogeneous Kernel-Based Convolutions for Deep CNNscited by 16
50 most cited of 52 All 52 (JSON)
Built on by
Not cited yet.