# Sensorless Freehand 3D Ultrasound Reconstruction via Deep Contextual Learning

arXiv: https://arxiv.org/abs/2006.07694 · HTML: https://mlsanity.com/paper/2006.07694/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 13 Jun 2020.

## Built on by (most cited first, 12 of 12)

- [Self Context and Shape Prior for Sensorless Freehand 3D Ultrasound Reconstruction](https://mlsanity.com/paper/2108.00274/) (2021)
- [Deep Motion Network for Freehand 3D Ultrasound Reconstruction](https://mlsanity.com/paper/2207.00177/) (2022)
- [End-to-end Ultrasound Frame to Volume Registration](https://mlsanity.com/paper/2107.06449/) (2021)
- [Trackerless freehand ultrasound with sequence modelling and auxiliary transformation over past and future frames](https://mlsanity.com/paper/2211.04867/) (2022)
- [Long-term Dependency for 3D Reconstruction of Freehand Ultrasound Without External Tracker](https://mlsanity.com/paper/2310.10248/) (2023)
- [NeRF-US: Removing Ultrasound Imaging Artifacts from Neural Radiance Fields in the Wild](https://mlsanity.com/paper/2408.10258/) (2024)
- [Multi-IMU with Online Self-Consistency for Freehand 3D Ultrasound Reconstruction](https://mlsanity.com/paper/2306.16197/) (2023)
- [TUS-REC2024: A Challenge to Reconstruct 3D Freehand Ultrasound Without External Tracker](https://mlsanity.com/paper/2506.21765/) (2025)
- [MoNetV2: Enhanced Motion Network for Freehand 3D Ultrasound Reconstruction](https://mlsanity.com/paper/2506.15835/) (2025)
- [Enhancing Free-hand 3D Photoacoustic and Ultrasound Reconstruction using Deep Learning](https://mlsanity.com/paper/2502.03505/) (2025)
- [DualTrack: Sensorless 3D Ultrasound needs Local and Global Context](https://mlsanity.com/paper/2509.09530/) (2025)
- [A Novel Augmented Reality Ultrasound Framework Using an RGB-D Camera and a 3D-printed Marker](https://mlsanity.com/paper/2205.04350/) (2022)

## Abstract (arXiv)

Transrectal ultrasound (US) is the most commonly used imaging modality to guide prostate biopsy and its 3D volume provides even richer context information. Current methods for 3D volume reconstruction from freehand US scans require external tracking devices to provide spatial position for every frame. In this paper, we propose a deep contextual learning network (DCL-Net), which can efficiently exploit the image feature relationship between US frames and reconstruct 3D US volumes without any tracking device. The proposed DCL-Net utilizes 3D convolutions over a US video segment for feature extraction. An embedded self-attention module makes the network focus on the speckle-rich areas for better spatial movement prediction. We also propose a novel case-wise correlation loss to stabilize the training process for improved accuracy. Highly promising results have been obtained by using the developed method. The experiments with ablation studies demonstrate superior performance of the proposed method by comparing against other state-of-the-art methods. Source code of this work is publicly available at https://github.com/DIAL-RPI/FreehandUSRecon.