Quanta Perception as Probabilistic Events
Not on the map. Why?
Abstract (arXiv)
Autonomous systems rely on extracting information from light, yet remain brittle in extreme environments, from nighttime navigation to high-speed robotics. Conventional sensors aggregate photons over fixed exposures, imposing trade-offs between sensitivity, dynamic range, and temporal resolution that degrade perception when photons are scarce or dynamics are rapid. Quanta sensors detect individual photons, but their streams exceed real-time compute and latency budgets by orders of magnitude. Here we introduce textitprobabilistic events, a computational primitive for real-time quanta perception from individual photon detections. By computing the posterior over the time since the last intensity change, we represent photon streams as recursive belief states. Rather than fixed-threshold event-camera triggers, this recursive Bayesian formulation yields three low-latency signals: motion-adaptive scene flux, high-fidelity activity maps, and entropy-based perceptual uncertainty. This representation enables perception in extreme conditions, including pose estimation of a running person at ~0.05 lux---without retraining vision models. Our approach processes input streams exceeding 50,000 quanta frames per second on commodity GPU hardware---yielding kilohertz-scale outputs up to four orders of magnitude faster than state-of-the-art quanta reconstruction baselines, even for megapixel arrays. By replacing frame reconstruction with direct probabilistic inference over photon streams, this work bridges photon-counting quanta sensing with robotic vision.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 2 of its 99 references that are in the map. First posted on arXiv 27 Aug 2026.
Builds on
2 of 99 references.
References · 2
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2024Depth Anything V2cited by 1,422
Built on by
Not cited yet.