RAUNet: Residual Attention U-Net for Semantic Segmentation of Cataract Surgical Instruments
Not on the map. Why?
Abstract (arXiv)
Semantic segmentation of surgical instruments plays a crucial role in robot-assisted surgery. However, accurate segmentation of cataract surgical instruments is still a challenge due to specular reflection and class imbalance issues. In this paper, an attention-guided network is proposed to segment the cataract surgical instrument. A new attention module is designed to learn discriminative features and address the specular reflection issue. It captures global context and encodes semantic dependencies to emphasize key semantic features, boosting the feature representation. This attention module has very few parameters, which helps to save memory. Thus, it can be flexibly plugged into other networks. Besides, a hybrid loss is introduced to train our network for addressing the class imbalance issue, which merges cross entropy and logarithms of Dice loss. A new dataset named Cata7 is constructed to evaluate our network. To the best of our knowledge, this is the first cataract surgical instrument dataset for semantic segmentation. Based on this dataset, RAUNet achieves state-of-the-art performance 97.71% mean Dice and 95.62% mean IOU.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 6; 2023: 4; 2024: 5; 2025: 3; 2026: 2.
27 papers.
Sort:
- 2021CTNet: Context-based Tandem Network for Semantic Segmentationcited by 43
- 2022D-Former: A U-shaped Dilated Transformer for 3D Medical Image Segmentationcited by 35
- 2022From Forks to Forceps: A New Framework for Instance Segmentation of Surgical Instrumentscited by 32
- 2024OphNet: A Large-Scale Video Benchmark for Ophthalmic Surgical Workflow Understandingcited by 31
- 2021LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videoscited by 15
- 2021Effective semantic segmentation in Cataract Surgery: What matters most?cited by 11
- 2023Attention Mechanisms in Medical Image Segmentation: A Surveycited by 9
- 2021ReCal-Net: Joint Region-Channel-Wise Calibrated Network for Semantic Segmentation in Cataract Surgery Videoscited by 8
- 2022Joint Class-Affinity Loss Correction for Robust Medical Image Segmentation with Noisy Labelscited by 8
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Reviewcited by 8
- 2022DeepPyramid: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videoscited by 7
- 2021Temporally Constrained Neural Networks (TCNN): A framework for semi-supervised video semantic segmentationcited by 6
15 more
- 2023Rectifying Noisy Labels with Sequential Prior: Multi-Scale Temporal Feature Affinity Learning for Robust Video Segmentationcited by 4
- 2025Rethinking Decoder Design: Improving Biomarker Segmentation Using Depth-to-Space Restoration and Residual Linear Attentioncited by 4
- 2022Category Guided Attention Network for Brain Tumor Segmentation in MRIcited by 3
- 2022A comprehensive survey on recent deep learning-based methods applied to surgical datacited by 3
- 2023Towards Surgical Context Inference and Translation to Gesturescited by 3
- 2024Phase-Informed Tool Segmentation for Manual Small-Incision Cataract Surgerycited by 3
- 2023LDMRes-Net: Enabling Efficient Medical Image Segmentation on IoT and Edge Platformscited by 1
- 2024Implantable Adaptive Cells: A Novel Enhancement for Pre-Trained U-Nets in Medical Image Segmentationcited by 1
- 2024SEMU-Net: A Segmentation-based Corrector for Fabrication Process Variations of Nanophotonics with Microscopic Imagescited by 1
- 2025Rethinking the Nested U-Net Approach: Enhancing Biomarker Segmentation with Attention Mechanisms and Multiscale Feature Fusioncited by 1
- 2021DeepPyram: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videoscited by 0
- 2021PL-Net: Progressive Learning Network for Medical Image Segmentationcited by 0
- 2024Y-CA-Net: A Convolutional Attention Based Network for Volumetric Medical Image Segmentationcited by 0
- 2026MedCAGD: Context-Aware Gated Decoder for Efficient Medical Image Segmentationcited by 0
- 2026Spectral-Morphological Attention U-Net: An Efficient Network for Active Wildfire Detectioncited by 0
- 2026Spectral-Morphological Attention U-Net: An Efficient Network for Active Wildfire Detection17 Jul 2026
- 2026MedCAGD: Context-Aware Gated Decoder for Efficient Medical Image Segmentation1 Jul 2026
- 2025Rethinking Decoder Design: Improving Biomarker Segmentation Using Depth-to-Space Restoration and Residual Linear Attention23 Jun 2025
- 2025Rethinking the Nested U-Net Approach: Enhancing Biomarker Segmentation with Attention Mechanisms and Multiscale Feature Fusion8 Apr 2025
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Review16 Feb 2025
- 2024SEMU-Net: A Segmentation-based Corrector for Fabrication Process Variations of Nanophotonics with Microscopic Images25 Nov 2024
- 2024Phase-Informed Tool Segmentation for Manual Small-Incision Cataract Surgery25 Nov 2024
- 2024Y-CA-Net: A Convolutional Attention Based Network for Volumetric Medical Image Segmentation1 Oct 2024
- 2024OphNet: A Large-Scale Video Benchmark for Ophthalmic Surgical Workflow Understanding11 Jun 2024
- 2024Implantable Adaptive Cells: A Novel Enhancement for Pre-Trained U-Nets in Medical Image Segmentation6 May 2024
- 2023Rectifying Noisy Labels with Sequential Prior: Multi-Scale Temporal Feature Affinity Learning for Robust Video Segmentation12 Jul 2023
- 2023LDMRes-Net: Enabling Efficient Medical Image Segmentation on IoT and Edge Platforms9 Jun 2023
15 more
- 2023Attention Mechanisms in Medical Image Segmentation: A Survey29 May 2023
- 2023Towards Surgical Context Inference and Translation to Gestures28 Feb 2023
- 2022From Forks to Forceps: A New Framework for Instance Segmentation of Surgical Instruments26 Nov 2022
- 2022A comprehensive survey on recent deep learning-based methods applied to surgical data3 Sep 2022
- 2022DeepPyramid: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videos4 Jul 2022
- 2022Joint Class-Affinity Loss Correction for Robust Medical Image Segmentation with Noisy Labels16 Jun 2022
- 2022Category Guided Attention Network for Brain Tumor Segmentation in MRI29 Mar 2022
- 2022D-Former: A U-shaped Dilated Transformer for 3D Medical Image Segmentation3 Jan 2022
- 2021Temporally Constrained Neural Networks (TCNN): A framework for semi-supervised video semantic segmentation27 Dec 2021
- 2021PL-Net: Progressive Learning Network for Medical Image Segmentation27 Oct 2021
- 2021ReCal-Net: Joint Region-Channel-Wise Calibrated Network for Semantic Segmentation in Cataract Surgery Videos25 Sep 2021
- 2021DeepPyram: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videos11 Sep 2021
- 2021Effective semantic segmentation in Cataract Surgery: What matters most?13 Aug 2021
- 2021LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videos2 Jul 2021
- 2021CTNet: Context-based Tandem Network for Semantic Segmentation20 Apr 2021
- 2021CTNet: Context-based Tandem Network for Semantic Segmentationcited by 43
- 2022D-Former: A U-shaped Dilated Transformer for 3D Medical Image Segmentationcited by 35
- 2022From Forks to Forceps: A New Framework for Instance Segmentation of Surgical Instrumentscited by 32
- 2024OphNet: A Large-Scale Video Benchmark for Ophthalmic Surgical Workflow Understandingcited by 31
- 2021LensID: A CNN-RNN-Based Framework Towards Lens Irregularity Detection in Cataract Surgery Videoscited by 15
- 2021Effective semantic segmentation in Cataract Surgery: What matters most?cited by 11
- 2023Attention Mechanisms in Medical Image Segmentation: A Surveycited by 9
- 2021ReCal-Net: Joint Region-Channel-Wise Calibrated Network for Semantic Segmentation in Cataract Surgery Videoscited by 8
- 2022Joint Class-Affinity Loss Correction for Robust Medical Image Segmentation with Noisy Labelscited by 8
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Reviewcited by 8
- 2022DeepPyramid: Enabling Pyramid View and Deformable Pyramid Reception for Semantic Segmentation in Cataract Surgery Videoscited by 7
- 2021Temporally Constrained Neural Networks (TCNN): A framework for semi-supervised video semantic segmentationcited by 6
12 most cited of 27 All 27 (JSON)
- 2026Spectral-Morphological Attention U-Net: An Efficient Network for Active Wildfire Detection17 Jul 2026
- 2026MedCAGD: Context-Aware Gated Decoder for Efficient Medical Image Segmentation1 Jul 2026
- 2025Rethinking Decoder Design: Improving Biomarker Segmentation Using Depth-to-Space Restoration and Residual Linear Attention23 Jun 2025
- 2025Rethinking the Nested U-Net Approach: Enhancing Biomarker Segmentation with Attention Mechanisms and Multiscale Feature Fusion8 Apr 2025
- 2025Surgical Scene Understanding in the Era of Foundation AI Models: A Comprehensive Review16 Feb 2025
- 2024SEMU-Net: A Segmentation-based Corrector for Fabrication Process Variations of Nanophotonics with Microscopic Images25 Nov 2024
- 2024Phase-Informed Tool Segmentation for Manual Small-Incision Cataract Surgery25 Nov 2024
- 2024Y-CA-Net: A Convolutional Attention Based Network for Volumetric Medical Image Segmentation1 Oct 2024
- 2024OphNet: A Large-Scale Video Benchmark for Ophthalmic Surgical Workflow Understanding11 Jun 2024
- 2024Implantable Adaptive Cells: A Novel Enhancement for Pre-Trained U-Nets in Medical Image Segmentation6 May 2024
- 2023Rectifying Noisy Labels with Sequential Prior: Multi-Scale Temporal Feature Affinity Learning for Robust Video Segmentation12 Jul 2023
- 2023LDMRes-Net: Enabling Efficient Medical Image Segmentation on IoT and Edge Platforms9 Jun 2023
12 newest of 27 All 27 (JSON)