mlsanityData to 7 Oct 2026

Colonoscopy Navigation using End-to-End Deep Visuomotor Control: A User Study

arXiv 2206.15086 ↗First posted 30 Jun 2022cs.RO cs.AIcited by 5

Not on the map. Why?

Abstract (arXiv)

Flexible endoscopes for colonoscopy present several limitations due to their inherent complexity, resulting in patient discomfort and lack of intuitiveness for clinicians. Robotic devices together with autonomous control represent a viable solution to reduce the workload of endoscopists and the training time while improving the overall procedure outcome. Prior works on autonomous endoscope control use heuristic policies that limit their generalisation to the unstructured and highly deformable colon environment and require frequent human intervention. This work proposes an image-based control of the endoscope using Deep Reinforcement Learning, called Deep Visuomotor Control (DVC), to exhibit adaptive behaviour in convoluted sections of the colon tract. DVC learns a mapping between the endoscopic images and the control signal of the endoscope. A first user study of 20 expert gastrointestinal endoscopists was carried out to compare their navigation performance with DVC policies using a realistic virtual simulator. The results indicate that DVC shows equivalent performance on several assessment parameters, being more safer. Moreover, a second user study with 20 novice participants was performed to demonstrate easier human supervision compared to a state-of-the-art heuristic control policy. Seamless supervision of colonoscopy procedures would enable interventionists to focus on the medical decision rather than on the control problem of the endoscope.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 15 of its 42 references that are in the map. First posted on arXiv 30 Jun 2022.

Builds on

15 of 42 references.

References · 15

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2015Continuous control with deep reinforcement learningcited by 3,279
  3. 2018Soft Actor-Critic Algorithms and Applicationscited by 1,179
  4. 2018DeepMind Control Suitecited by 935
  5. 2015End-to-End Training of Deep Visuomotor Policiescited by 847
  6. 2021How to Train Your Robot with Deep Reinforcement Learning; Lessons We've Learnedcited by 201
  7. 2021SurRoL: An Open-source Reinforcement Learning Centered and dVRK Compatible Platform for Surgical Robot Learningcited by 28
  8. 2019Open-Sourced Reinforcement Learning Environments for Surgical Roboticscited by 24
  9. 2020VR-Caps: A Virtual Environment for Capsule Endoscopycited by 23
  10. 2021Learning from Demonstrations for Autonomous Soft-tissue Retractioncited by 15
  11. 2017Exploring Convolutional Networks for End-to-End Visual Servoingcited by 10
  12. 2021Cooperative Assistance in Robotic Surgery through Multi-Agent Reinforcement Learningcited by 10
3 more
  1. 2022ASHA: Assistive Teleoperation via Human-in-the-Loop Reinforcement Learningcited by 8
  2. 2021Depth estimation of endoscopy using sim-to-real transfercited by 6
  3. 2021Learning Friction Model for Tethered Capsule Robotcited by 1

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 3; 2025: 1.

5 papers.