Automatic Probe Movement Guidance for Freehand Obstetric Ultrasound
Not on the map. Why?
Abstract (arXiv)
We present the first system that provides real-time probe movement guidance for acquiring standard planes in routine freehand obstetric ultrasound scanning. Such a system can contribute to the worldwide deployment of obstetric ultrasound scanning by lowering the required level of operator expertise. The system employs an artificial neural network that receives the ultrasound video signal and the motion signal of an inertial measurement unit (IMU) that is attached to the probe, and predicts a guidance signal. The network termed US-GuideNet predicts either the movement towards the standard plane position (goal prediction), or the next movement that an expert sonographer would perform (action prediction). While existing models for other ultrasound applications are trained with simulations or phantoms, we train our model with real-world ultrasound video and probe motion data from 464 routine clinical scans by 17 accredited sonographers. Evaluations for 3 standard plane types show that the model provides a useful guidance signal with an accuracy of 88.8% for goal prediction and 90.9% for action prediction.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 8 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 4; 2024: 8; 2025: 2; 2026: 5.
28 papers.
Sort:
By area:
- 2021Autonomous Navigation of an Ultrasound Probe Towards Standard Scan Planes with Deep Reinforcement Learningcited by 21
- 2024Cardiac Copilot: Automatic Probe Guidance for Echocardiography with World Modelcited by 16
- 2025EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidancecited by 15
- 2021AutoFB: Automating Fetal Biometry Estimation from Standard Ultrasound Planescited by 14
- 2023Intelligent Robotic Sonographer: Mutual Information-based Disentangled Reward Learning from Few Demonstrationscited by 14
- 2022VesNet-RL: Simulation-based Reinforcement Learning for Real-World US Probe Navigationcited by 12
- 2024Structure-aware World Model for Probe Guidance via Large-scale Self-supervised Pre-traincited by 7
- 2021Image-Guided Navigation of a Robotic Ultrasound Probe for Autonomous Spinal Sonography Using a Shadow-aware Dual-Agent Frameworkcited by 6
- 2022Adaptive 3D Localization of 2D Freehand Ultrasound Brain Imagescited by 6
- 2024Goal-conditioned reinforcement learning for ultrasound navigation guidancecited by 6
- 2021Learning Robotic Ultrasound Scanning Skills via Human Demonstrations and Guided Explorationscited by 3
- 2022Multi-Atlas Segmentation and Spatial Alignment of the Human Embryo in First Trimester 3D Ultrasoundcited by 3
16 more
- 2022Multimodal-GuideNet: Gaze-Probe Bidirectional Guidance in Obstetric Ultrasound Scanningcited by 3
- 2023Ultrasound Plane Pose Regression: Assessing Generalized Pose Coordinates in the Fetal Braincited by 3
- 2024UltraSeP: Sequence-aware Pre-training for Echocardiography Probe Movement Guidancecited by 3
- 2021Learning Ultrasound Scanning Skills from Human Demonstrationscited by 2
- 2024HUP-3D: A 3D multi-view synthetic dataset for assisted-egocentric hand-ultrasound pose estimationcited by 2
- 2024Pose-GuideNet: Automatic Scanning Guidance for Fetal Head Ultrasound from Pose Estimationcited by 2
- 2025VA-Adapter: Adapting Ultrasound Foundation Model to Echocardiography Probe Guidancecited by 1
- 2026Echo-POSED: Geometric Self-Distillation for Echocardiography Guidancecited by 1
- 2023Towards a Simple Framework of Skill Transfer Learning for Robotic Ultrasound-guidance Procedurescited by 0
- 2023Learning Autonomous Ultrasound via Latent Task Representation and Robotic Skills Adaptationcited by 0
- 2024Measuring proximity to standard planes during fetal brain ultrasound scanningcited by 0
- 2024Regional quality estimation for echocardiography using deep learningcited by 0
- 2026Uncertainty-Calibrated Explainable Artificial Intelligence for Fetal Ultrasound Plane Classification: A Systematic Reviewcited by 0
- 2026UltraStar: Semantic-Aware Star Graph Modeling for Echocardiography Navigationcited by 0
- 2026SAMe: A Semantic Anatomy Mapping Engine for Robotic Ultrasoundcited by 0
- 2026Ultrasound Operator Guidance Using World Modeling and Retrieval Based Action Planningcited by 0
- 2026Ultrasound Operator Guidance Using World Modeling and Retrieval Based Action Planning5 Oct 2026
- 2026Echo-POSED: Geometric Self-Distillation for Echocardiography Guidance30 May 2026
- 2026SAMe: A Semantic Anatomy Mapping Engine for Robotic Ultrasound28 Apr 2026
- 2026UltraStar: Semantic-Aware Star Graph Modeling for Echocardiography Navigation2 Mar 2026
- 2026Uncertainty-Calibrated Explainable Artificial Intelligence for Fetal Ultrasound Plane Classification: A Systematic Review2 Jan 2026
- 2025VA-Adapter: Adapting Ultrasound Foundation Model to Echocardiography Probe Guidance8 Oct 2025
- 2025EchoWorld: Learning Motion-Aware World Models for Echocardiography Probe Guidance17 Apr 2025
- 2024UltraSeP: Sequence-aware Pre-training for Echocardiography Probe Movement Guidance27 Aug 2024
- 2024Pose-GuideNet: Automatic Scanning Guidance for Fetal Head Ultrasound from Pose Estimation19 Aug 2024
- 2024Regional quality estimation for echocardiography using deep learning1 Aug 2024
- 2024HUP-3D: A 3D multi-view synthetic dataset for assisted-egocentric hand-ultrasound pose estimation12 Jul 2024
- 2024Structure-aware World Model for Probe Guidance via Large-scale Self-supervised Pre-train28 Jun 2024
16 more
- 2024Cardiac Copilot: Automatic Probe Guidance for Echocardiography with World Model19 Jun 2024
- 2024Goal-conditioned reinforcement learning for ultrasound navigation guidance2 May 2024
- 2024Measuring proximity to standard planes during fetal brain ultrasound scanning10 Apr 2024
- 2023Learning Autonomous Ultrasound via Latent Task Representation and Robotic Skills Adaptation25 Jul 2023
- 2023Intelligent Robotic Sonographer: Mutual Information-based Disentangled Reward Learning from Few Demonstrations7 Jul 2023
- 2023Towards a Simple Framework of Skill Transfer Learning for Robotic Ultrasound-guidance Procedures6 May 2023
- 2023Ultrasound Plane Pose Regression: Assessing Generalized Pose Coordinates in the Fetal Brain19 Jan 2023
- 2022Adaptive 3D Localization of 2D Freehand Ultrasound Brain Images12 Sep 2022
- 2022Multimodal-GuideNet: Gaze-Probe Bidirectional Guidance in Obstetric Ultrasound Scanning26 Jul 2022
- 2022VesNet-RL: Simulation-based Reinforcement Learning for Real-World US Probe Navigation10 May 2022
- 2022Multi-Atlas Segmentation and Spatial Alignment of the Human Embryo in First Trimester 3D Ultrasound14 Feb 2022
- 2021Learning Ultrasound Scanning Skills from Human Demonstrations9 Nov 2021
- 2021Image-Guided Navigation of a Robotic Ultrasound Probe for Autonomous Spinal Sonography Using a Shadow-aware Dual-Agent Framework3 Nov 2021
- 2021Learning Robotic Ultrasound Scanning Skills via Human Demonstrations and Guided Explorations2 Nov 2021
- 2021AutoFB: Automating Fetal Biometry Estimation from Standard Ultrasound Planes12 Jul 2021
- 2021Autonomous Navigation of an Ultrasound Probe Towards Standard Scan Planes with Deep Reinforcement Learning1 Mar 2021
- 2021Autonomous Navigation of an Ultrasound Probe Towards Standard Scan Planes with Deep Reinforcement Learningcited by 21
- 2024Cardiac Copilot: Automatic Probe Guidance for Echocardiography with World Modelcited by 16
- 2021AutoFB: Automating Fetal Biometry Estimation from Standard Ultrasound Planescited by 14
- 2023Intelligent Robotic Sonographer: Mutual Information-based Disentangled Reward Learning from Few Demonstrationscited by 14
- 2022VesNet-RL: Simulation-based Reinforcement Learning for Real-World US Probe Navigationcited by 12
- 2021Image-Guided Navigation of a Robotic Ultrasound Probe for Autonomous Spinal Sonography Using a Shadow-aware Dual-Agent Frameworkcited by 6
- 2022Adaptive 3D Localization of 2D Freehand Ultrasound Brain Imagescited by 6
- 2024Goal-conditioned reinforcement learning for ultrasound navigation guidancecited by 6
- 2021Learning Robotic Ultrasound Scanning Skills via Human Demonstrations and Guided Explorationscited by 3
- 2022Multi-Atlas Segmentation and Spatial Alignment of the Human Embryo in First Trimester 3D Ultrasoundcited by 3
- 2022Multimodal-GuideNet: Gaze-Probe Bidirectional Guidance in Obstetric Ultrasound Scanningcited by 3
- 2023Ultrasound Plane Pose Regression: Assessing Generalized Pose Coordinates in the Fetal Braincited by 3
12 most cited of 25 All 25 (JSON)
- 2026Echo-POSED: Geometric Self-Distillation for Echocardiography Guidance30 May 2026
- 2026SAMe: A Semantic Anatomy Mapping Engine for Robotic Ultrasound28 Apr 2026
- 2026UltraStar: Semantic-Aware Star Graph Modeling for Echocardiography Navigation2 Mar 2026
- 2026Uncertainty-Calibrated Explainable Artificial Intelligence for Fetal Ultrasound Plane Classification: A Systematic Review2 Jan 2026
- 2025VA-Adapter: Adapting Ultrasound Foundation Model to Echocardiography Probe Guidance8 Oct 2025
- 2024UltraSeP: Sequence-aware Pre-training for Echocardiography Probe Movement Guidance27 Aug 2024
- 2024Pose-GuideNet: Automatic Scanning Guidance for Fetal Head Ultrasound from Pose Estimation19 Aug 2024
- 2024Regional quality estimation for echocardiography using deep learning1 Aug 2024
- 2024HUP-3D: A 3D multi-view synthetic dataset for assisted-egocentric hand-ultrasound pose estimation12 Jul 2024
- 2024Cardiac Copilot: Automatic Probe Guidance for Echocardiography with World Model19 Jun 2024
- 2024Goal-conditioned reinforcement learning for ultrasound navigation guidance2 May 2024
- 2024Measuring proximity to standard planes during fetal brain ultrasound scanning10 Apr 2024
12 newest of 25 All 25 (JSON)