# Structured light with a million light planes per second

arXiv: https://arxiv.org/abs/2411.18597 · HTML: https://mlsanity.com/paper/2411.18597/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 16 of its 77 references that are in the map.
- First posted on arXiv 27 Nov 2024.

## Builds on (most cited first, 16 of 16)

- [Event-based Vision: A Survey](https://mlsanity.com/paper/1904.08405/) (2019)
- [TimeLens: Event-based Video Frame Interpolation](https://mlsanity.com/paper/2106.07286/) (2021)
- [Bringing a Blurry Frame Alive at High Frame-Rate with an Event Camera](https://mlsanity.com/paper/1811.10180/) (2018)
- [Event-Based Fusion for Motion Deblurring with Cross-modal Attention](https://mlsanity.com/paper/2112.00167/) (2021)
- [Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusion](https://mlsanity.com/paper/2203.17191/) (2022)
- [Continuous-time Intensity Estimation Using Event Cameras](https://mlsanity.com/paper/1811.00386/) (2018)
- [Virtual Wave Optics for Non-Line-of-Sight Imaging](https://mlsanity.com/paper/1810.07535/) (2018)
- [Motion Deblurring with Real Events](https://mlsanity.com/paper/2109.13695/) (2021)
- [Learning to Deblur and Generate High Frame Rate Video with an Event Camera](https://mlsanity.com/paper/2003.00847/) (2020)
- [ESL: Event-based Structured Light](https://mlsanity.com/paper/2111.15510/) (2021)
- [Event Guided Depth Sensing](https://mlsanity.com/paper/2110.10505/) (2021)
- [Event-Based Structured Light for Depth Reconstruction using Frequency Tagged Light Patterns](https://mlsanity.com/paper/1811.10771/) (2018)
- [Single-Photon Structured Light](https://mlsanity.com/paper/2204.05300/) (2022)
- [Photorealistic Image Reconstruction from Hybrid Intensity and Event based Sensor](https://mlsanity.com/paper/1805.06140/) (2018)
- [Depth Reconstruction with Neural Signed Distance Fields in Structured Light Systems](https://mlsanity.com/paper/2405.12006/) (2024)
- [Event-based Motion-Robust Accurate Shape Estimation for Mixed Reflectance Scenes](https://mlsanity.com/paper/2311.09652/) (2023)

## Abstract (arXiv)

We introduce a structured light system that enables full-frame 3D scanning at speeds of 1000 fps, four times faster than the previous fastest systems. Our key innovation is the use of a custom acousto-optic light scanning device capable of projecting two million light planes per second. Coupling this device with an event camera allows our system to overcome the key bottleneck preventing previous structured light systems based on event cameras from achieving higher scanning speeds -- the limited rate of illumination steering. Unlike these previous systems, ours uses the event camera's full-frame bandwidth, shifting the speed bottleneck from the illumination side to the imaging side. To mitigate this new bottleneck and further increase scanning speed, we introduce adaptive scanning strategies that leverage the event camera's asynchronous operation by selectively illuminating regions of interest, thereby achieving effective scanning speeds an order of magnitude beyond the camera's theoretical limit.