mlsanityData to 14 Oct 2026

Distilling Temporal Coherence into 2D Networks for Transrectal Ultrasound Prostate Video Segmentation

arXiv 2606.31198 ↗First posted 30 Jun 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Real-time video segmentation of the prostate in Transrectal Ultrasound (TRUS) is essential for image-guided interventions. While conventional 2D methods suffer from inter-frame inconsistencies by disregarding temporal context, 3D architectures incur prohibitive latency. To resolve this dilemma, we present a Temporally Consistent Learning Framework that distills temporal coherence into a 2D network during training, preserving single-frame inference efficiency. Our design is driven by a key clinical observation: the prostate exhibits geometric stability, whereas the surrounding acoustic environment fluctuates due to physiological motion and transducer pressure. Because conventional temporal constraints propagate erroneous gradients from these unstable regions, we introduce a Confidence-Weighted Temporal Consistency objective derived from optical flow warping residuals, selectively attenuating contributions from unreliable regions. Complementing this pixel-wise constraint, a Dual-scale Prototype Alignment Module enforces semantic coherence through contrastive optimization of local boundary and global semantic features. Furthermore, to eliminate the need for dense per-frame video annotations, we employ geometric equivariance-based pseudo-labeling with knowledge distillation from a pretrained teacher. Extensive experiments on SUN-SEG and our newly introduced TRUS-V benchmark (2,679 frames) demonstrate state-of-the-art accuracy and temporal consistency at real-time speed. Code and dataset are available at https://github.com/DYDevelop/DTC-TRUS.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 31 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

20 of 31 references.

References · 20

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  4. 2020Exploring Simple Siamese Representation Learningcited by 2,866
  5. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  6. 2015Spatial Transformer Networkscited by 1,429
  7. 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
  8. 2020PraNet: Parallel Reverse Attention Network for Polyp Segmentationcited by 460
  9. 2019PANet: Few-Shot Image Semantic Segmentation with Prototype Alignmentcited by 449
  10. 2018Learning Blind Video Temporal Consistencycited by 253
  11. 2023MedNeXt: Transformer-driven Scaling of ConvNets for Medical Image Segmentationcited by 162
  12. 2022Video Polyp Segmentation: A Deep Learning Perspectivecited by 82
8 more
  1. 2019Semi-Supervised Medical Image Segmentation via Learning Consistency under Transformationscited by 71
  2. 2021MSRF-Net: A Multi-Scale Residual Fusion Network for Biomedical Image Segmentationcited by 53
  3. 2023Adaptive Context Selection for Polyp Segmentationcited by 47
  4. 2023TransNetR: Transformer-based Residual Network for Polyp Segmentation with Multi-Center Out-of-Distribution Testingcited by 26
  5. 2019Deep Attentive Features for Prostate Segmentation in 3D Transrectal Ultrasoundcited by 23
  6. 2024SALI: Short-term Alignment and Long-term Interaction Network for Colonoscopy Video Polyp Segmentationcited by 19
  7. 2023Shifting More Attention to Breast Lesion Segmentation in Ultrasound Videoscited by 16
  8. 2016Fine-grained Recurrent Neural Networks for Automatic Prostate Segmentation in Ultrasound Imagescited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Domain Generalization for Prostate Segmentation in Transrectal Ultrasound Images: A Multi-center Study
  2. 2021Automatic Segmentation of the Prostate on 3D Trans-rectal Ultrasound Images using Statistical Shape Models and Convolutional Neural Networks
  3. 2025MR2US-Pro: Prostate MR to Ultrasound Image Translation and Registration Based on Diffusion Models
  4. 2026EchoPilot: Training-Free Ultrasound Video Segmentation via Scale-Space Semantic Prompting and Reliability-Gated Memory
  5. 2026Align then Refine: Text-Guided 3D Prostate Lesion Segmentation
  6. 2025Modality Translation and Registration of MR and Ultrasound Images Using Diffusion Models
  7. 2022Collaborative Quantization Embeddings for Intra-Subject Prostate MR Image Registration
  8. 2026UCBound-Net: Uncertainty-Guided Boundary-Aware Continual Learning for Domain-Incremental Ultrasound Segmentation