Evidential Active Recognition: Intelligent and Prudent Open-World Embodied Perception
Not on the map. Why?
Abstract (arXiv)
Active recognition enables robots to intelligently explore novel observations, thereby acquiring more information while circumventing undesired viewing conditions. Recent approaches favor learning policies from simulated or collected data, wherein appropriate actions are more frequently selected when the recognition is accurate. However, most recognition modules are developed under the closed-world assumption, which makes them ill-equipped to handle unexpected inputs, such as the absence of the target object in the current observation. To address this issue, we propose treating active recognition as a sequential evidence-gathering process, providing by-step uncertainty quantification and reliable prediction under the evidence combination theory. Additionally, the reward function developed in this paper effectively characterizes the merit of actions when operating in open-world environments. To evaluate the performance, we collect a dataset from an indoor simulator, encompassing various recognition challenges such as distance, occlusion levels, and visibility. Through a series of experiments on recognition and robustness analysis, we demonstrate the necessity of introducing uncertainties to active recognition and the superior performance of the proposed method.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 36 of its 57 references that are in the map. First posted on arXiv 23 Nov 2023.
Builds on
36 of 57 references.
References · 36
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2017Mask R-CNNcited by 7,259
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2021Video Swin Transformercited by 1,090
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
24 more
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2020Object Goal Navigation using Goal-Oriented Semantic Explorationcited by 421
- 2019Deep Evidential Regressioncited by 354
- 2018Fast Online Object Tracking and Segmentation: A Unifying Approachcited by 272
- 2015Beyond Short Snippets: Deep Networks for Video Classificationcited by 233
- 2020Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networkscited by 227
- 2020Efficient and Scalable Bayesian Neural Nets with Rank-1 Factorscited by 171
- 2022Trusted Multi-View Classification with Dynamic Evidential Fusioncited by 167
- 2015Bayesian Convolutional Neural Networks with Bernoulli Approximate Variational Inferencecited by 159
- 2021Evidential Deep Learning for Open Set Action Recognitioncited by 96
- 2018Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learningcited by 91
- 2016Revisiting Active Perceptioncited by 90
- 2020An Exploration of Embodied Visual Explorationcited by 56
- 2017A Dataset for Developing and Benchmarking Active Visioncited by 50
- 2022Continuous Scene Representations for Embodied AIcited by 39
- 2022Zero-shot object goal visual navigationcited by 29
- 2022Interactron: Embodied Adaptive Object Detectioncited by 21
- 2018Geometry-Aware Recurrent Neural Networks for Active Visual Recognitioncited by 20
- 2020Embodied Visual Active Learning for Semantic Segmentationcited by 19
- 2016Look-ahead before you leap: end-to-end active recognition by forecasting the effect of motioncited by 17
- 2019Emergence of Exploratory Look-Around Behaviors through Active Observation Completioncited by 14
- 2018Sidekick Policy Learning for Active Visual Explorationcited by 11
- 2023Learning to View: Decision Transformers for Active Object Detectioncited by 10
- 2023Flexible Visual Recognition by Evidential Modeling of Confusion and Ignorancecited by 6
Built on by
Citing papers per year: 2024: 6; 2025: 5; 2026: 4.
15 papers.
Sort:
By area:
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 175
- 2025World-in-World: World Models in a Closed-Loop Worldcited by 44
- 2024A Comprehensive Survey on Evidential Deep Learning and Its Applicationscited by 25
- 2024GenEx: Generating an Explorable Worldcited by 20
- 2025A Survey on Agentic Multimodal Large Language Modelscited by 19
- 2024Generative World Explorercited by 12
- 2025WoMAP: World Models For Embodied Open-Vocabulary Object Localizationcited by 8
- 2024Percept, Chat, and then Adapt: Multimodal Knowledge Transfer of Foundation Models for Open-World Video Recognitioncited by 6
- 2024Observe Then Act: Asynchronous Active Vision-Action Model for Robotic Manipulationcited by 4
- 20263D Gaussian Map with Open-Set Semantic Grouping for Vision-Language Navigationcited by 4
- 2025Embodied Domain Adaptation for Object Detectioncited by 3
- 2026Towards Next-Generation Healthcare: A Survey of Medical Embodied AI for Perception, Decision-Making, and Actioncited by 2
3 more
- 2026PInVerify: An Offline Embodied Benchmark for Active Instance Verification28 May 2026
- 20263D Gaussian Map with Open-Set Semantic Grouping for Vision-Language Navigation26 May 2026
- 2026Towards Next-Generation Healthcare: A Survey of Medical Embodied AI for Perception, Decision-Making, and Action5 Apr 2026
- 2026See, Act, Adapt: Active Perception for Unsupervised Cross-Domain Visual Adaptation via Personalized VLM-Guided Agent27 Feb 2026
- 2025Open Set Face Forgery Detection via Dual-Level Evidence Collection3 Dec 2025
- 2025World-in-World: World Models in a Closed-Loop World20 Oct 2025
- 2025A Survey on Agentic Multimodal Large Language Models13 Oct 2025
- 2025Embodied Domain Adaptation for Object Detection27 Jun 2025
- 2025WoMAP: World Models For Embodied Open-Vocabulary Object Localization2 Jun 2025
- 2024GenEx: Generating an Explorable World12 Dec 2024
- 2024Generative World Explorer18 Nov 2024
- 2024Observe Then Act: Asynchronous Active Vision-Action Model for Robotic Manipulation23 Sep 2024
3 more
- 2024A Comprehensive Survey on Evidential Deep Learning and Its Applications7 Sep 2024
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI9 Jul 2024
- 2024Percept, Chat, and then Adapt: Multimodal Knowledge Transfer of Foundation Models for Open-World Video Recognition29 Feb 2024
- 2025A Survey on Agentic Multimodal Large Language Modelscited by 19
- 2025A Survey on Agentic Multimodal Large Language Models13 Oct 2025
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 175
- 2024A Comprehensive Survey on Evidential Deep Learning and Its Applicationscited by 25
- 2024GenEx: Generating an Explorable Worldcited by 20
- 2024Generative World Explorercited by 12
- 2024Percept, Chat, and then Adapt: Multimodal Knowledge Transfer of Foundation Models for Open-World Video Recognitioncited by 6
- 2024Observe Then Act: Asynchronous Active Vision-Action Model for Robotic Manipulationcited by 4
- 20263D Gaussian Map with Open-Set Semantic Grouping for Vision-Language Navigationcited by 4
- 2025Embodied Domain Adaptation for Object Detectioncited by 3
- 2026Towards Next-Generation Healthcare: A Survey of Medical Embodied AI for Perception, Decision-Making, and Actioncited by 2
- 2025Open Set Face Forgery Detection via Dual-Level Evidence Collectioncited by 0
- 2026PInVerify: An Offline Embodied Benchmark for Active Instance Verificationcited by 0
- 2026PInVerify: An Offline Embodied Benchmark for Active Instance Verification28 May 2026
- 20263D Gaussian Map with Open-Set Semantic Grouping for Vision-Language Navigation26 May 2026
- 2026Towards Next-Generation Healthcare: A Survey of Medical Embodied AI for Perception, Decision-Making, and Action5 Apr 2026
- 2025Open Set Face Forgery Detection via Dual-Level Evidence Collection3 Dec 2025
- 2025Embodied Domain Adaptation for Object Detection27 Jun 2025
- 2024GenEx: Generating an Explorable World12 Dec 2024
- 2024Generative World Explorer18 Nov 2024
- 2024Observe Then Act: Asynchronous Active Vision-Action Model for Robotic Manipulation23 Sep 2024
- 2024A Comprehensive Survey on Evidential Deep Learning and Its Applications7 Sep 2024
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AI9 Jul 2024
- 2024Percept, Chat, and then Adapt: Multimodal Knowledge Transfer of Foundation Models for Open-World Video Recognition29 Feb 2024