mlsanityData to 14 Oct 2026

Adaptive Observation Control for Active Visual Recognition

arXiv 2610.19624 ↗First posted 14 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Visual recognition models usually process a fixed view under a fixed computation budget, although images often benefit from different scales and amounts of spatial evidence. Active vision can adapt by observing a coarse scene and then selecting informative fixations, but the public AdaptiveNN-DeiT-S pipeline still fixes both field of view and observation count. We extend this fixed-step recognizer with a controllable observation interface that adapts both the field of view and the number of fixations to the input. Specifically, the model predicts a per-fixation scale that sets its field of view, refines each selected crop with optional scale-gated foveation and a residual high-resolution detail-token branch, and uses label-grounded stop heads for input-dependent early termination. Experiments across fine-grained benchmarks, full ImageNet-1K, and ImageNet-A/R-derived classification splits show that the interface remains competitive with fixed-step references while exposing a controllable observation budget. The same checkpoint enables threshold-controlled accuracy-compute trade-offs without per-threshold retraining. On sequential ImageNet-1K, the learned stop rule outperforms fixed-step truncation of the same checkpoint, sustaining 81.9% top-1 using 2.45 of the four focus steps and exceeding three-step truncation at lower cost. On each benchmark, a variant combining scale control and detail-token fusion achieves the highest accuracy among the tested component-added non-exit variants. Our code is available at https://github.com/GZHU-DVL/LI-Dikai.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 35 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

24 of 35 references.

References · 24

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  4. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  5. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  6. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
  7. 2013Fine-Grained Visual Classification of Aircraftcited by 1,726
  8. 2015Spatial Transformer Networkscited by 1,429
  9. 2019Natural Adversarial Examplescited by 1,408
  10. 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 864
  11. 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 596
  12. 2021Dynamic Neural Networks: A Surveycited by 408
12 more
  1. 2021AdaViT: Adaptive Tokens for Efficient Vision Transformercited by 362
  2. 2014Recurrent Models of Visual Attentioncited by 349
  3. 2019Depth-Adaptive Transformercited by 236
  4. 2021Not All Images are Worth 16x16 Words: Dynamic Transformers for Efficient Image Recognitioncited by 144
  5. 2014Part-based R-CNNs for Fine-grained Category Detectioncited by 109
  6. 2020Glance and Focus: a Dynamic Approach to Reducing Spatial Redundancy in Image Classificationcited by 100
  7. 2021FOVEA: Foveated Image Magnification for Autonomous Navigationcited by 32
  8. 2021FoveaTer: Foveated Transformer for Image Classificationcited by 28
  9. 2020Emergent Properties of Foveated Perceptual Systemscited by 24
  10. 2025Emulating Human-like Adaptive Vision for Efficient and Flexible Machine Visual Perceptioncited by 15
  11. 2023Foveation in the Era of Deep Learningcited by 8
  12. 2026LLMind: Bio-inspired Training-free Adaptive Visual Representations for Vision-Language Modelscited by 7

Built on by

Not cited yet.