mlsanityData to 14 Oct 2026

Neuromorphic Optical Tracking and Imaging of Randomly Moving Targets through Strongly Scattering Media

arXiv 2501.03874 ↗First posted 7 Jan 2025cs.NE cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Tracking and acquiring simultaneous optical images of randomly moving targets obscured by scattering media remains a challenging problem of importance to many applications that require precise object localization and identification. In this work we develop an end-to-end neuromorphic optical engineering and computational approach to demonstrate how to track and image normally invisible objects by combining an event detecting camera with a multistage neuromorphic deep learning strategy. Photons emerging from dense scattering media are detected by the event camera and converted to pixel-wise asynchronized spike trains - a first step in isolating object-specific information from the dominant uninformative background. Spiking data is fed into a deep spiking neural network (SNN) engine where object tracking and image reconstruction are performed by two separate yet interconnected modules running in parallel in discrete time steps over the event duration. Through benchtop experiments we demonstrate tracking and imaging randomly moving objects in dense turbid media as well as image reconstruction of spatially stationary but optically dynamic objects. Standardized character sets serve as representative proxies for geometrically complex objects, underscoring the method's generality. The results highlight the advantages of a fully neuromorphic approach in meeting a major imaging technology with high computational efficiency and low power consumption.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 82 references that are in the map. First posted on arXiv 7 Jan 2025.

Builds on

23 of 82 references.

References · 23

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2019Event-based Vision: A Surveycited by 1,016
  3. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
  4. 2015Holistically-Nested Edge Detectioncited by 592
  5. 2015Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccadescited by 314
  6. 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 259
  7. 2024Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chipscited by 103
  8. 2021Efficient Neuromorphic Signal Processing with Loihi 2cited by 96
  9. 2020DIET-SNN: Direct Input Encoding With Leakage and Threshold Optimization in Deep Spiking Neural Networkscited by 71
  10. 2021HIRE-SNN: Harnessing the Inherent Robustness of Energy-Efficient Deep Spiking Neural Networks by Training with Crafted Input Noisecited by 65
  11. 2024SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networkscited by 40
  12. 2020Exploiting Neuron and Synapse Filter Dynamics in Spatial Temporal Learning of Deep Spiking Neural Networkcited by 37
11 more
  1. 2023Optical flow estimation from event-based cameras and spiking neural networkscited by 33
  2. 2021A Fully Spiking Hybrid Neural Network for Energy-Efficient Object Detectioncited by 31
  3. 2023Training Full Spike Neural Networks via Auxiliary Accumulation Pathwaycited by 26
  4. 2022Spiking Neural Networks for Frame-based and Event-based Single Object Localizationcited by 18
  5. 2023EventLFM: Event Camera integrated Fourier Light Field Microscopy for Ultrafast 3D imagingcited by 12
  6. 2021High Resolution, Deep Imaging Using Confocal Time-of-flight Diffuse Optical Tomographycited by 5
  7. 2023An Asynchronous Wireless Network for Capturing Event-Driven Data from Large Populations of Autonomous Sensorscited by 5
  8. 2022Tracking moving objects through scattering media via speckle correlationscited by 2
  9. 2022Enhancing Speckle Statistics for Imaging inside Scattering Mediacited by 2
  10. 2024A Spiking Neural Network Decoder for Implantable Brain Machine Interfaces and its Sparsity-aware Deployment on RISC-V Microcontrollerscited by 2
  11. 2019Noninvasive super-resolution imaging through scattering mediacited by 1

Built on by

Not cited yet.