mlsanityData to 14 Oct 2026

Quanta Perception as Probabilistic Events

arXiv 2608.27584 ↗First posted 27 Aug 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Autonomous systems rely on extracting information from light, yet remain brittle in extreme environments, from nighttime navigation to high-speed robotics. Conventional sensors aggregate photons over fixed exposures, imposing trade-offs between sensitivity, dynamic range, and temporal resolution that degrade perception when photons are scarce or dynamics are rapid. Quanta sensors detect individual photons, but their streams exceed real-time compute and latency budgets by orders of magnitude. Here we introduce textitprobabilistic events, a computational primitive for real-time quanta perception from individual photon detections. By computing the posterior over the time since the last intensity change, we represent photon streams as recursive belief states. Rather than fixed-threshold event-camera triggers, this recursive Bayesian formulation yields three low-latency signals: motion-adaptive scene flux, high-fidelity activity maps, and entropy-based perceptual uncertainty. This representation enables perception in extreme conditions, including pose estimation of a running person at ~0.05 lux---without retraining vision models. Our approach processes input streams exceeding 50,000 quanta frames per second on commodity GPU hardware---yielding kilohertz-scale outputs up to four orders of magnitude faster than state-of-the-art quanta reconstruction baselines, even for megapixel arrays. By replacing frame reconstruction with direct probabilistic inference over photon streams, this work bridges photon-counting quanta sensing with robotic vision.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 2 of its 99 references that are in the map. First posted on arXiv 27 Aug 2026.

Builds on

2 of 99 references.

References · 2

  1. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  2. 2024Depth Anything V2cited by 1,422

Built on by

Not cited yet.