OSCAR: Occupancy-based Shape Completion via Acoustic Neural Implicit Representations
Not on the map. Why?
Abstract (arXiv)
Accurate 3D reconstruction of vertebral anatomy from ultrasound is important for guiding minimally invasive spine interventions, but it remains challenging due to acoustic shadowing and view-dependent signal variations. We propose an occupancy-based shape completion method that reconstructs complete 3D anatomical geometry from partial ultrasound observations. Crucially for intra-operative applications, our approach extracts the anatomical surface directly from the image, avoiding the need for anatomical labels during inference. This label-free completion relies on a coupled latent space representing both the image appearance and the underlying anatomical shape. By leveraging a Neural Implicit Representation (NIR) that jointly models both spatial occupancy and acoustic interactions, the method uses acoustic parameters to become implicitly aware of the unseen regions without explicit shadowing labels through tracking acoustic signal transmission. We show that this method outperforms state-of-the-art shape completion for B-mode ultrasound by 80% in HD95 score. We validate our approach both in-silico and on phantom US images with registered mesh models from CT labels, demonstrating accurate reconstruction of occluded anatomy and robust generalization across diverse imaging conditions. Code and data will be released on publication.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 19 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
12 of 19 references.
References · 12
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2020VerSe: A Vertebrae Labelling and Segmentation Benchmark for Multi-detector CT Imagescited by 111
- 2023NISF: Neural Implicit Segmentation Functionscited by 29
- 2023Ultra-NeRF: Neural Radiance Fields for Ultrasound Imagingcited by 27
- 2020Autonomous Robotic Screening of Tubular Structures based only on Real-Time Ultrasound Imaging Feedbackcited by 26
- 2025Fit Pixels, Get Labels: Meta-learned Implicit Networks for Image Segmentationcited by 11
- 2024RoCoSDF: Row-Column Scanned Neural Signed Distance Fields for Freehand 3D Ultrasound Imaging Shape Reconstructioncited by 5
- 2024Shape Completion in the Dark: Completing Vertebrae Morphology from 3D Ultrasoundcited by 3
- 2025Steerable Anatomical Shape Synthesis with Implicit Neural Representationscited by 3
- 2025UltrON: Ultrasound Occupancy Networkscited by 3
- 2025US-X Complete: A Multi-Modal Approach to Anatomical 3D Shape Recoverycited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.