Active Spiking Perception: The Membrane Potential as a Belief State for Anytime 3D Point Cloud Recognition
Not on the map. Why?
Abstract (arXiv)
Spiking point cloud networks usually scan space in a fixed, input-agnostic order, which leaves the most distinctive resource of spiking computation, the temporal evolution of the membrane potential, unused as a locus of decision-making. Active Spiking Perception (ASP) recasts 3D recognition as an iterative decision process in which the network's own leaky integrate-and-fire (LIF) membrane potential, read as a running belief over the class, selects the next chunk to observe and triggers confidence-margin early exit. A lightweight Slice-Selection Policy scores unvisited farthest-point-sampled chunks from the membrane state and precomputed geometric descriptors, trains end-to-end through a straight-through Gumbel-Softmax, reduces to an argmax at inference, and adds about 2% of backbone parameters. We prove that leaky integration is the recursive log-posterior update of a Bayesian filter, that the exit rule attains distribution-free selective risk with no multiple-testing penalty at the stopping time, and that streaming state carry-forward is exactly equivalent to prefix recomputation with bounded finite-precision drift. ASP reaches 90.62% and 93.28% on ModelNet40 and ModelNet10, 1.7 points below the strongest spiking baseline at a larger backbone, while adding a certified anytime interface no baseline offers. The mechanism transfers unchanged to dense prediction, giving 83.21 instance mIoU on ShapeNetPart and 48.50 mIoU on S3DIS Area 5, to our knowledge the first spiking results on S3DIS Area 5, and, fixation replacing chunk selection, to a foveated non-spiking transformer, so the policy is not tied to spiking backbones: cost is exactly linear in observations and the threshold is a measured compute dial spanning 2.8x to 1.35x less energy. One limitation is concrete: one S3DIS class is unidentifiable at the crop size we use, and we give the prediction that would fix it.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 51 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
37 of 51 references.
References · 37
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2020Point Transformercited by 1,470
- 2019Contrastive Multiview Codingcited by 1,301
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 864
- 2017Selective Classification for Deep Neural Networkscited by 852
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
25 more
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 596
- 2016Adaptive Computation Time for Recurrent Neural Networkscited by 506
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
- 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 379
- 2022Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizationscited by 363
- 2014Recurrent Models of Visual Attentioncited by 349
- 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 345
- 2022Confident Adaptive Language Modelingcited by 310
- 2022Conformal Risk Controlcited by 299
- 2021PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Cloudscited by 211
- 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 198
- 2015DRAW: A Recurrent Neural Network For Image Generationcited by 191
- 2017SEGCloud: Semantic Segmentation of 3D Point Cloudscited by 179
- 2021SPViT: Enabling Faster Vision Transformers via Soft Token Pruningcited by 167
- 2023Constructing Deep Spiking Neural Networks from Artificial Neural Networks with Knowledge Distillationcited by 44
- 2022An Analytical Estimation of Spiking Neural Networks Energy Efficiencycited by 38
- 2023Membrane Potential Batch Normalization for Spiking Neural Networkscited by 35
- 2023Spiking PointNet: Spiking Neural Networks for Point Cloudscited by 34
- 2021FoveaTer: Foveated Transformer for Image Classificationcited by 28
- 2020Distilling Spikes: Knowledge Distillation in Spiking Neural Networkscited by 27
- 2024Efficient 3D Recognition with Event-driven Spike Sparse Convolutioncited by 11
- 2025Spiking Point Transformer for Point Cloud Classificationcited by 7
- 2025Efficient Spiking Point Mamba for Point Cloud Analysiscited by 4
- 2024Adaptive Point Transformercited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026The Sparsity Ceiling: Where Spiking Networks Can and Cannot Trade Activity for Energy
- 2025STEP: A Unified Spiking Transformer Evaluation Platform for Fair and Reproducible Benchmarking
- 2025NeuCODEX: Edge-Cloud Co-Inference with Spike-Driven Compression and Dynamic Early-Exit
- 2024P-SpikeSSM: Harnessing Probabilistic Spiking State Space Models for Long-Range Dependency Tasks
- 2026Uncertainty-Aware Token Importance Estimation in Spiking Transformers
- 2026PTQ4SNN: Membrane-Aware Post-Training Quantization for Spiking Neural Networks
- 2025Spiking Decision Transformers: Local Plasticity, Phase-Coding, and Dendritic Routing for Low-Power Sequence Control
- 2026Vision SmolMamba: Spike-Guided Token Pruning for Energy-Efficient Spiking State-Space Vision Models