Colonoscopy Navigation using End-to-End Deep Visuomotor Control: A User Study
Not on the map. Why?
Abstract (arXiv)
Flexible endoscopes for colonoscopy present several limitations due to their inherent complexity, resulting in patient discomfort and lack of intuitiveness for clinicians. Robotic devices together with autonomous control represent a viable solution to reduce the workload of endoscopists and the training time while improving the overall procedure outcome. Prior works on autonomous endoscope control use heuristic policies that limit their generalisation to the unstructured and highly deformable colon environment and require frequent human intervention. This work proposes an image-based control of the endoscope using Deep Reinforcement Learning, called Deep Visuomotor Control (DVC), to exhibit adaptive behaviour in convoluted sections of the colon tract. DVC learns a mapping between the endoscopic images and the control signal of the endoscope. A first user study of 20 expert gastrointestinal endoscopists was carried out to compare their navigation performance with DVC policies using a realistic virtual simulator. The results indicate that DVC shows equivalent performance on several assessment parameters, being more safer. Moreover, a second user study with 20 novice participants was performed to demonstrate easier human supervision compared to a state-of-the-art heuristic control policy. Seamless supervision of colonoscopy procedures would enable interventionists to focus on the medical decision rather than on the control problem of the endoscope.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 15 of its 42 references that are in the map. First posted on arXiv 30 Jun 2022.
Builds on
15 of 42 references.
References · 15
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2018Soft Actor-Critic Algorithms and Applicationscited by 1,179
- 2018DeepMind Control Suitecited by 935
- 2015End-to-End Training of Deep Visuomotor Policiescited by 847
- 2021How to Train Your Robot with Deep Reinforcement Learning; Lessons We've Learnedcited by 201
- 2021SurRoL: An Open-source Reinforcement Learning Centered and dVRK Compatible Platform for Surgical Robot Learningcited by 28
- 2019Open-Sourced Reinforcement Learning Environments for Surgical Roboticscited by 24
- 2020VR-Caps: A Virtual Environment for Capsule Endoscopycited by 23
- 2021Learning from Demonstrations for Autonomous Soft-tissue Retractioncited by 15
- 2017Exploring Convolutional Networks for End-to-End Visual Servoingcited by 10
- 2021Cooperative Assistance in Robotic Surgery through Multi-Agent Reinforcement Learningcited by 10
3 more
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 1.
5 papers.
- 2023Surgical Gym: A high-performance GPU-based platform for reinforcement learning with surgical robotscited by 5
- 2024PR-ENDO: Physically Based Relightable Gaussian Splatting for Endoscopycited by 4
- 2024Safe Navigation for Robotic Digestive Endoscopy via Human Intervention-based Reinforcement Learningcited by 1
- 2024V2-SfMLearner: Learning Monocular Depth and Ego-motion for Multimodal Wireless Capsule Endoscopycited by 0
- 2025Curriculum-Based Reinforcement Learning for Autonomous UAV Navigation in Unknown Curved Tubular Conduitcited by 0
- 2025Curriculum-Based Reinforcement Learning for Autonomous UAV Navigation in Unknown Curved Tubular Conduit11 Dec 2025
- 2024V2-SfMLearner: Learning Monocular Depth and Ego-motion for Multimodal Wireless Capsule Endoscopy23 Dec 2024
- 2024PR-ENDO: Physically Based Relightable Gaussian Splatting for Endoscopy19 Nov 2024
- 2024Safe Navigation for Robotic Digestive Endoscopy via Human Intervention-based Reinforcement Learning24 Sep 2024
- 2023Surgical Gym: A high-performance GPU-based platform for reinforcement learning with surgical robots7 Oct 2023