# Event2Audio: Event-Based Optical Vibration Sensing

arXiv: https://arxiv.org/abs/2507.03273 · HTML: https://mlsanity.com/paper/2507.03273/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 15 of its 89 references that are in the map.
- First posted on arXiv 4 Jul 2025.

## Builds on (most cited first, 15 of 15)

- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [Event-based Vision: A Survey](https://mlsanity.com/paper/1904.08405/) (2019)
- [Deep Learning for Audio Signal Processing](https://mlsanity.com/paper/1905.00078/) (2019)
- [Secrets of Event-Based Optical Flow](https://mlsanity.com/paper/2207.10022/) (2022)
- [Event Based, Near Eye Gaze Tracking Beyond 10,000Hz](https://mlsanity.com/paper/2004.03577/) (2020)
- [Separate Anything You Describe](https://mlsanity.com/paper/2308.05037/) (2023)
- [Music Demixing Challenge 2021](https://mlsanity.com/paper/2108.13559/) (2021)
- [Neural Spline Fields for Burst Image Fusion and Layer Separation](https://mlsanity.com/paper/2312.14235/) (2023)
- [EventLFM: Event Camera integrated Fourier Light Field Microscopy for Ultrafast 3D imaging](https://mlsanity.com/paper/2310.00730/) (2023)
- [SoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer](https://mlsanity.com/paper/2409.08425/) (2024)
- [3D Motion Magnification: Visualizing Subtle Motions with Time Varying Radiance Fields](https://mlsanity.com/paper/2308.03757/) (2023)
- [Event-Based Motion Magnification](https://mlsanity.com/paper/2402.11957/) (2024)
- [Noise2Image: Noise-Enabled Static Scene Recovery for Event Cameras](https://mlsanity.com/paper/2404.01298/) (2024)
- [Benchmarks and leaderboards for sound demixing tasks](https://mlsanity.com/paper/2305.07489/) (2023)
- [Visual Vibration Tomography: Estimating Interior Material Properties from Monocular Video](https://mlsanity.com/paper/2104.02735/) (2021)

## Built on by (most cited first, 3 of 3)

- [Learning to See Inside Opaque Liquid Containers using Speckle Vibrometry](https://mlsanity.com/paper/2507.20757/) (2025)
- [Optical Linear Systems Framework for Event Sensing and Computational Neuromorphic Imaging](https://mlsanity.com/paper/2601.13498/) (2026)
- [Hearing the Room Through the Shape of the Drum: Modal-Guided Sound Recovery from Multi-Point Surface Vibrations](https://mlsanity.com/paper/2604.26678/) (2026)

## Abstract (arXiv)

Small vibrations observed in video can unveil information beyond what is visual, such as sound and material properties. It is possible to passively record these vibrations when they are visually perceptible, or actively amplify their visual contribution with a laser beam when they are not perceptible. In this paper, we improve upon the active sensing approach by leveraging event-based cameras, which are designed to efficiently capture fast motion. We demonstrate our method experimentally by recovering audio from vibrations, even for multiple simultaneous sources, and in the presence of environmental distortions. Our approach matches the state-of-the-art reconstruction quality at much faster speeds, approaching real-time processing.