HVPNet: A Bio-Inspired Network for General Salient and Camouflaged Object Detection
Not on the map. Why?
Abstract (arXiv)
In recent years, most research on multimodal salient object detection (SOD) and camouflaged object detection (COD) typically aims to improve performance through complex cross-modal feature fusion and decoding structures. However, this approach leads to an excessively large model parameter scale and often fails to deliver satisfactory detection performance due to structural redundancy. In contrast, the human visual process is able to efficiently perform salient and camouflaged object identification without such complex structures. This contrast raises an important question: Can we draw conceptual inspiration from the human visual process to achieve a simpler modeling strategy, and still realize accurate and efficient object detection? To answer this question, we propose HVPNet, a simple yet general bio-inspired computational architecture. Drawing on the multi-layered information integration of the retina as a conceptual metaphor, we designed a Retinal Integration Module (RIM), which effectively integrates multimodal features through a level-specific multi-stage integration strategy. To fully exploit these features, we further design a cortical decoder (CD) that breaks down the decoding process into low- and high-level visual stages, abstracting the hierarchical processing in the human visual cortex. Benefiting from these designs, HVPNet can readily extend to seven tasks across four modalities. Without bells and whistles, it establishes an excellent accuracy-efficiency trade-off across 22 datasets spanning these seven tasks. Our code is available at https://github.com/jiaweiXu1029/HVPNet.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 44 of its 99 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
44 of 99 references.
References · 44
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
- 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,068
- 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
- 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 751
- 2019Object Detection in 20 Years: A Surveycited by 531
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2021Anabranch Network for Camouflaged Object Segmentationcited by 227
- 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
32 more
- 2021Simultaneously Localize, Segment and Rank the Camouflaged Objectscited by 198
- 2015Visual Saliency Based on Multiscale Deep Featurescited by 185
- 2021Visual Saliency Transformercited by 175
- 2022Zoom In and Out: A Mixed-scale Triplet Network for Camouflaged Object Detectioncited by 145
- 2021Salient Object Detection via Integrity Learningcited by 133
- 2023Explicit Visual Prompting for Low-Level Structure Segmentationscited by 114
- 2023Feature Shrinkage Pyramid for Camouflaged Object Detection with Transformerscited by 87
- 2021Video Summarization Using Deep Neural Networks: A Surveycited by 85
- 2016It's Moving! A Probabilistic Model for Causal Motion Segmentation in Moving Camera Videoscited by 71
- 2020RGBT Salient Object Detection: A Large-scale Dataset and Benchmarkcited by 69
- 2022Deep Gradient Learning for Efficient Camouflaged Object Detectioncited by 65
- 2022Implicit Motion Handling for Video Camouflaged Object Detectioncited by 60
- 2019RGB-T Image Saliency Detection via Collaborative Graph Learningcited by 58
- 2022CamoFormer: Masked Separable Attention for Camouflaged Object Detectioncited by 58
- 2023VSCode: General Visual Salient and Camouflaged Object Detection with 2D Prompt Learningcited by 58
- 2022Source-free Depth for Object Pop-outcited by 52
- 2017A Unified RGB-T Saliency Detection Benchmark: Dataset, Baselines, Analysis and A Novel Approachcited by 51
- 2022A Unified Transformer Framework for Group-based Segmentation: Co-Segmentation, Co-Saliency Detection and Video Salient Object Detectioncited by 51
- 2022CIR-Net: Cross-modality Interaction and Refinement for RGB-D Salient Object Detectioncited by 38
- 2022Unsupervised Video Object Segmentation via Prototype Memory Networkcited by 30
- 2023VST++: Efficient and Stronger Visual Saliency Transformercited by 28
- 2021Recurrent Glimpse-based Decoder for Detection with Transformercited by 21
- 2024Exploring Deeper! Segment Anything Model with Depth Perception for Camouflaged Object Detectioncited by 20
- 2024Learning Adaptive Fusion Bank for Multi-modal Salient Object Detectioncited by 19
- 2024Hierarchical Graph Interaction Transformer with Dynamic Token Clustering for Camouflaged Object Detectioncited by 18
- 2023DC-Net: Divide-and-Conquer for Salient Object Detectioncited by 12
- 2022GroupTransNet: Group Transformer Network for RGB-D Salient Object Detectioncited by 7
- 2026TP-Seg: Task-Prototype Framework for Unified Medical Lesion Segmentationcited by 7
- 2024MambaSOD: Dual Mamba-Driven Cross-Modal Fusion Network for RGB-D Salient Object Detectioncited by 6
- 2025Lightweight RGB-D Salient Object Detection from a Speed-Accuracy Tradeoff Perspectivecited by 6
- 2026DifferSeg: Towards Diverse Multimodal Binary Segmentation via Differential Perception and Frequency Guidancecited by 6
- 2024Seamless Detection: Unifying Salient Object Detection and Camouflaged Object Detectioncited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Rethinking Layer-Wise Information Allocation for Vision Foundation Model Adaptationcited by 7
- 2026ViCo-SAM3: Vision-Conditioned Alignment for Open-Vocabulary Camouflaged Object Segmentationcited by 1
- 2026Understanding and Overcoming Cross-modal Fusion Bias in Multimodal Anomaly Detection From A Fisher Information Perspectivecited by 0
- 2026S2A:Semantic-to-Spatial Alignment for Alignment-Free RGB-T Salient Object Detectioncited by 0
- 2026S2A:Semantic-to-Spatial Alignment for Alignment-Free RGB-T Salient Object Detection23 Sep 2026
- 2026ViCo-SAM3: Vision-Conditioned Alignment for Open-Vocabulary Camouflaged Object Segmentation14 Sep 2026
- 2026Understanding and Overcoming Cross-modal Fusion Bias in Multimodal Anomaly Detection From A Fisher Information Perspective2 Aug 2026
- 2026Rethinking Layer-Wise Information Allocation for Vision Foundation Model Adaptation24 Jul 2026