HTT-Net: Hierarchical Text-guided Transition Modeling for Surgical Video Phase Recognition
Not on the map. Why?
Abstract (arXiv)
Surgical video phase recognition is a fundamental task in computer-assisted intervention, supporting workflow understanding, intraoperative guidance, and surgical quality assessment. Although recent visual-temporal models have achieved promising progress, accurate and temporally coherent phase recognition remains challenging due to local visual ambiguity, transient prediction noise, and insufficient use of procedural semantics. To address these challenges, we propose HTT-Net, a Hierarchical Text-guided Transition modeling Network for surgical video phase recognition. The key idea is to introduce structured surgical semantic knowledge into phase-aware segment construction and semantic refinement. Specifically, we construct a hierarchical surgical semantic memory with intra-phase descriptions, inter-phase transition descriptions, and fine-grained semantic units. Based on this memory, the proposed Transition-Aware Segment Construction (TAS-Con) organizes frame-level evidence into coherent segment representations and handles boundary clips with inter-phase transition descriptions. Furthermore, we introduce Transition-Aware Segment Calibration (TAS-Calib), which calibrates phase-aware segment representations through hierarchical surgical semantics and improves discrimination under visual ambiguity without dense frame-level vision-language fusion. Experiments on Cholec80 and LCRS-100 demonstrate the effectiveness of HTT-Net for robust surgical video phase recognition.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 85 references that are in the map. First posted on arXiv 18 Jul 2026.
Builds on
10 of 85 references.
References · 10
- 2023Metrics Matter in Surgical Phase Recognitioncited by 14
- 2026CreatiParser: Generative Image Parsing of Raster Graphic Designs into Editable Layerscited by 9
- 2025EmoVerse: A MLLMs-Driven Emotion Representation Dataset for Interpretable Visual Emotion Analysiscited by 7
- 2026FACE-net: Factual Calibration and Emotion Augmentation for Retrieval-enhanced Emotional Video Captioningcited by 7
- 2024SR-Mamba: Effective Surgical Phase Recognition with State Space Modelcited by 6
- 2026A Multi-Agent Framework with Structured Reasoning and Reflective Refinement for Multimodal Empathetic Response Generationcited by 5
- 2026Towards Accurate Emotion-Attributed Video Captioning via Fine-grained Emotion-Cause Pair Extractioncited by 4
- 2026EmoStyle: Affective Conditioning of Style-Specialist Experts for Emotional Image Generationcited by 3
- 2025HistLLM: A Unified Framework for LLM-Based Multimodal Recommendation with User History Encoding and Compressioncited by 1
- 2026Geometry-aware Gaussian Prior and Axial Attention for Cervical Cytology Image Classificationcited by 1
Built on by
Not cited yet.