mlsanityData to 14 Oct 2026

DeepTraverse: A Depth-First Search Inspired Network for Algorithmic Visual Understanding

arXiv 2506.10084 ↗First posted 11 Jun 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Conventional vision backbones, despite their success, often construct features through a largely uniform cascade of operations, offering limited explicit pathways for adaptive, iterative refinement. This raises a compelling question: can principles from classical search algorithms instill a more algorithmic, structured, and logical processing flow within these networks, leading to representations built through more interpretable, perhaps reasoning-like decision processes? We introduce DeepTraverse, a novel vision architecture directly inspired by algorithmic search strategies, enabling it to learn features through a process of systematic elucidation and adaptive refinement distinct from conventional approaches. DeepTraverse operationalizes this via two key synergistic components: recursive exploration modules that methodically deepen feature analysis along promising representational paths with parameter sharing for efficiency, and adaptive calibration modules that dynamically adjust feature salience based on evolving global context. The resulting algorithmic interplay allows DeepTraverse to intelligently construct and refine feature patterns. Comprehensive evaluations across a diverse suite of image classification benchmarks show that DeepTraverse achieves highly competitive classification accuracy and robust feature discrimination, often outperforming conventional models with similar or larger parameter counts. Our work demonstrates that integrating such algorithmic priors provides a principled and effective strategy for building more efficient, performant, and structured vision backbones.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 60 references that are in the map. First posted on arXiv 11 Jun 2025.

Builds on

52 of 60 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  7. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  8. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  9. 2022A ConvNet for the 2020scited by 3,579
  10. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
  11. 2016Wide Residual Networkscited by 3,070
  12. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
38 more
  1. 2019Searching for MobileNetV3cited by 1,994
  2. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  3. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  4. 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
  5. 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,228
  6. 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
  7. 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,136
  8. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
  9. 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
  10. 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
  11. 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 569
  12. 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 569
  13. 2021LeViT: a Vision Transformer in ConvNet's Clothing for Faster Inferencecited by 475
  14. 2022DeiT III: Revenge of the ViTcited by 419
  15. 2019GhostNet: More Features from Cheap Operationscited by 410
  16. 2021Bottleneck Transformers for Visual Recognitioncited by 364
  17. 2021XCiT: Cross-Covariance Image Transformerscited by 338
  18. 2022EfficientFormer: Vision Transformers at MobileNet Speedcited by 241
  19. 2021Mobile-Former: Bridging MobileNet and Transformercited by 235
  20. 2021Scaling Local Self-Attention for Parameter Efficient Visual Backbonescited by 220
  21. 2018Compositional Attention Networks for Machine Reasoningcited by 183
  22. 2022Separable Self-attention for Mobile Vision Transformerscited by 163
  23. 2019Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolutioncited by 140
  24. 2023Run, Don't Walk: Chasing Higher FLOPS for Faster Neural Networkscited by 130
  25. 2022QuadTree Attention for Vision Transformerscited by 129
  26. 2021SOFT: Softmax-free Transformer with Linear Complexitycited by 128
  27. 2021CycleMLP: A MLP-like Architecture for Dense Predictioncited by 126
  28. 2017CondenseNet: An Efficient DenseNet using Learned Group Convolutionscited by 122
  29. 2019Neural Execution of Graph Algorithmscited by 121
  30. 2022EdgeViTs: Competing Light-weight CNNs on Mobile Devices with Vision Transformerscited by 116
  31. 2021AS-MLP: An Axial Shifted MLP Architecture for Visioncited by 101
  32. 2021Are we ready for a new paradigm shift? A Survey on Visual Deep MLPcited by 63
  33. 2024Rewrite the Starscited by 55
  34. 2014Rigid-Motion Scattering for Texture Classificationcited by 52
  35. 2022LightViT: Towards Light-Weight Convolution-Free Vision Transformerscited by 40
  36. 2022When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanismcited by 30
  37. 2021MicroNet: Improving Image Recognition with Extremely Low FLOPscited by 26
  38. 2019HetConv: Heterogeneous Kernel-Based Convolutions for Deep CNNscited by 16

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.