# StofNet: Super-resolution Time of Flight Network

arXiv: https://arxiv.org/abs/2308.12009 · HTML: https://mlsanity.com/paper/2308.12009/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 11 of its 25 references that are in the map.
- First posted on arXiv 23 Aug 2023.

## Builds on (most cited first, 11 of 11)

- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Enhanced Deep Residual Networks for Single Image Super-Resolution](https://mlsanity.com/paper/1707.02921/) (2017)
- [Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network](https://mlsanity.com/paper/1609.05158/) (2016)
- [Speaker Recognition from Raw Waveform with SincNet](https://mlsanity.com/paper/1808.00158/) (2018)
- [BatVision: Learning to See 3D Spatial Layout with Two Ears](https://mlsanity.com/paper/1912.07011/) (2019)
- [Beyond Image to Depth: Improving Depth Prediction using Echoes](https://mlsanity.com/paper/2103.08468/) (2021)
- [Super-resolution Ultrasound Localization Microscopy through Deep Learning](https://mlsanity.com/paper/1804.07661/) (2018)
- [Extending GCC-PHAT using Shift Equivariant Neural Networks](https://mlsanity.com/paper/2208.04654/) (2022)
- [Multimodal Exponentially Modified Gaussian Oscillators](https://mlsanity.com/paper/2209.12202/) (2022)
- [Geometric Ultrasound Localization Microscopy](https://mlsanity.com/paper/2306.15548/) (2023)
- [3-Dimensional Sonic Phase-invariant Echo Localization](https://mlsanity.com/paper/2306.08281/) (2023)

## Abstract (arXiv)

Time of Flight (ToF) is a prevalent depth sensing technology in the fields of robotics, medical imaging, and non-destructive testing. Yet, ToF sensing faces challenges from complex ambient conditions making an inverse modelling from the sparse temporal information intractable. This paper highlights the potential of modern super-resolution techniques to learn varying surroundings for a reliable and accurate ToF detection. Unlike existing models, we tailor an architecture for sub-sample precise semi-global signal localization by combining super-resolution with an efficient residual contraction block to balance between fine signal details and large scale contextual information. We consolidate research on ToF by conducting a benchmark comparison against six state-of-the-art methods for which we employ two publicly available datasets. This includes the release of our SToF-Chirp dataset captured by an airborne ultrasound transducer. Results showcase the superior performance of our proposed StofNet in terms of precision, reliability and model complexity. Our code is available at https://github.com/hahnec/stofnet.
