mlsanityData to 7 Oct 2026

Evidential Active Recognition: Intelligent and Prudent Open-World Embodied Perception

arXiv 2311.13793 ↗First posted 23 Nov 2023cs.CV cs.ROcited by 15

Not on the map. Why?

Abstract (arXiv)

Active recognition enables robots to intelligently explore novel observations, thereby acquiring more information while circumventing undesired viewing conditions. Recent approaches favor learning policies from simulated or collected data, wherein appropriate actions are more frequently selected when the recognition is accurate. However, most recognition modules are developed under the closed-world assumption, which makes them ill-equipped to handle unexpected inputs, such as the absence of the target object in the current observation. To address this issue, we propose treating active recognition as a sequential evidence-gathering process, providing by-step uncertainty quantification and reliable prediction under the evidence combination theory. Additionally, the reward function developed in this paper effectively characterizes the merit of actions when operating in open-world environments. To evaluate the performance, we collect a dataset from an indoor simulator, encompassing various recognition challenges such as distance, occlusion levels, and visibility. Through a series of experiments on recognition and robustness analysis, we demonstrate the necessity of introducing uncertainties to active recognition and the superior performance of the proposed method.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 36 of its 57 references that are in the map. First posted on arXiv 23 Nov 2023.

Builds on

36 of 57 references.

References · 36

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  6. 2017Mask R-CNNcited by 7,259
  7. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
  8. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  9. 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
  10. 2021Video Swin Transformercited by 1,090
  11. 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
  12. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
24 more
  1. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
  2. 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
  3. 2019Deep Evidential Regressioncited by 354
  4. 2018Fast Online Object Tracking and Segmentation: A Unifying Approachcited by 272
  5. 2015Beyond Short Snippets: Deep Networks for Video Classificationcited by 233
  6. 2020Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networkscited by 227
  7. 2020Efficient and Scalable Bayesian Neural Nets with Rank-1 Factorscited by 171
  8. 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 167
  9. 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
  10. 2021Evidential Deep Learning for Open Set Action Recognitioncited by 96
  11. 2018Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learningcited by 91
  12. 2016Revisiting Active Perceptioncited by 90
  13. 2020An Exploration of Embodied Visual Explorationcited by 56
  14. 2017A Dataset for Developing and Benchmarking Active Visioncited by 50
  15. 2022Continuous Scene Representations for Embodied AIcited by 39
  16. 2022Zero-shot object goal visual navigationcited by 29
  17. 2022Interactron: Embodied Adaptive Object Detectioncited by 21
  18. 2018Geometry-Aware Recurrent Neural Networks for Active Visual Recognitioncited by 20
  19. 2020Embodied Visual Active Learning for Semantic Segmentationcited by 19
  20. 2016Look-ahead before you leap: end-to-end active recognition by forecasting the effect of motioncited by 17
  21. 2019Emergence of Exploratory Look-Around Behaviors through Active Observation Completioncited by 14
  22. 2018Sidekick Policy Learning for Active Visual Explorationcited by 11
  23. 2023Learning to View: Decision Transformers for Active Object Detectioncited by 10
  24. 2023Flexible Visual Recognition by Evidential Modeling of Confusion and Ignorancecited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 6; 2025: 5; 2026: 4.

15 papers.

Sort:

By area: