mlsanityData to 7 Oct 2026

CalibNet: Dual-branch Cross-modal Calibration for RGB-D Salient Instance Segmentation

arXiv 2307.08098 ↗First posted 16 Jul 2023cs.CVcited by 10

Not on the map. Why?

Abstract (arXiv)

We propose a novel approach for RGB-D salient instance segmentation using a dual-branch cross-modal feature calibration architecture called CalibNet. Our method simultaneously calibrates depth and RGB features in the kernel and mask branches to generate instance-aware kernels and mask features. CalibNet consists of three simple modules, a dynamic interactive kernel (DIK) and a weight-sharing fusion (WSF), which work together to generate effective instance-aware kernels and integrate cross-modal features. To improve the quality of depth features, we incorporate a depth similarity assessment (DSA) module prior to DIK and WSF. In addition, we further contribute a new DSIS dataset, which contains 1,940 images with elaborate instance-level annotations. Extensive experiments on three challenging benchmarks show that CalibNet yields a promising result, i.e., 58.0% AP with 320*480 input size on the COME15K-N test set, which significantly surpasses the alternative frameworks. Our code and dataset are available at: https://github.com/PJLallen/CalibNet.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 58 of its 90 references that are in the map. First posted on arXiv 16 Jul 2023.

Builds on

58 of 90 references.

References · 58

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  3. 2020End-to-End Object Detection with Transformerscited by 7,384
  4. 2017Mask R-CNNcited by 7,259
  5. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  6. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
  7. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  8. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  9. 2017Non-local Neural Networkscited by 2,290
  10. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  11. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
  12. 2019Hybrid Task Cascade for Instance Segmentationcited by 479
38 more
  1. 2019YOLACT: Real-time Instance Segmentationcited by 441
  2. 2019Cascade R-CNN: High Quality Object Detection and Instance Segmentationcited by 428
  3. 2020Conditional Convolutions for Instance Segmentationcited by 314
  4. 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 302
  5. 2019Mask Scoring R-CNNcited by 265
  6. 2014The Secrets of Salient Object Segmentationcited by 200
  7. 2019CenterMask : Real-Time Anchor-Free Instance Segmentationcited by 200
  8. 2021Visual Saliency Transformercited by 175
  9. 2021Instances as Queriescited by 157
  10. 2020BlendMask: Top-Down Meets Bottom-Up for Instance Segmentationcited by 144
  11. 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 137
  12. 2019Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarkscited by 133
  13. 2014Learning Rich Features from RGB-D Images for Object Detection and Segmentationcited by 124
  14. 2021P2T: Pyramid Pooling Transformer for Scene Understandingcited by 84
  15. 2020RGB-D Salient Object Detection: A Surveycited by 73
  16. 2021Specificity-preserving RGB-D Saliency Detectioncited by 70
  17. 2020A Single Stream Network for Robust and Real-time RGB-D Salient Object Detectioncited by 67
  18. 2020Siamese Network for RGB-D Salient Object Detection and Beyondcited by 67
  19. 2020Learning RGB-D Feature Embeddings for Unseen Object Instance Segmentationcited by 64
  20. 2021Mask Transfiner for High-Quality Instance Segmentationcited by 64
  21. 2022Sparse Instance Activation for Real-Time Instance Segmentationcited by 63
  22. 2020Uncertainty Inspired RGB-D Saliency Detectioncited by 56
  23. 2020Accurate RGB-D Salient Object Detection via Collaborative Learningcited by 52
  24. 2021RGB-D Saliency Detection via Cascaded Mutual Information Minimizationcited by 50
  25. 2020Cross-Modal Weighting Network for RGB-D Salient Object Detectioncited by 47
  26. 2016RGBD Salient Object Detection via Deep Fusioncited by 46
  27. 2020DPANet: Depth Potentiality-Aware Gated Attention Network for RGB-D Salient Object Detectioncited by 45
  28. 2021SOTR: Segmenting Objects with Transformerscited by 42
  29. 2021MultiSiam: Self-supervised Multi-instance Siamese Representation Learning for Autonomous Drivingcited by 41
  30. 2020Progressively Guided Alternate Refinement Network for RGB-D Salient Object Detectioncited by 40
  31. 2017Instance-Level Salient Object Segmentationcited by 38
  32. 2020Learning Selective Mutual Attention and Contrast for RGB-D Saliency Detectioncited by 38
  33. 2022CIR-Net: Cross-modality Interaction and Refinement for RGB-D Salient Object Detectioncited by 38
  34. 2020Bilateral Attention Network for RGB-D Salient Object Detectioncited by 35
  35. 2021SOLO: A Simple Framework for Instance Segmentationcited by 32
  36. 2022OSFormer: One-Stage Camouflaged Instance Segmentation with Transformerscited by 30
  37. 2022Exploring Intra- and Inter-Video Relation for Surgical Semantic Scene Segmentationcited by 27
  38. 2020MobileSal: Extremely Efficient RGB-D Salient Object Detectioncited by 25

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 3; 2026: 3.

10 papers.

  1. 2025USIS16K: High-Quality Dataset for Underwater Salient Instance Segmentationcited by 10
  2. 2024Rethinking Detecting Salient and Camouflaged Objects in Unconstrained Scenescited by 7
  3. 2024Evaluation Study on SAM 2 for Class-agnostic Instance-level Segmentationcited by 5
  4. 2025Synergistic Bleeding Region and Point Detection in Laparoscopic Surgical Videoscited by 3
  5. 2024YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systemscited by 2
  6. 2024Dual-modal Prior Semantic Guided Infrared and Visible Image Fusion for Intelligent Transportation Systemcited by 1
  7. 2025GAPNet: A Lightweight Framework for Image and Video Salient Object Detection via Granularity-Aware Paradigmcited by 1
  8. 2026USIS-PGM: Photometric Gaussian Mixtures for Underwater Salient Instance Segmentationcited by 1
  9. 2026SPDA-SAM: A Self-prompted Depth-Aware Segment Anything Model for Instance Segmentationcited by 0
  10. 2026Two-Stream Interactive Joint Learning of Scene Parsing and Geometric Vision Taskscited by 0