mlsanityData to 7 Oct 2026

Breaking Diversity Collapse in Spiking Pseudo-Ensembles for Efficient OOD Detection in Remote Sensing

arXiv 2608.01090 ↗First posted 2 Aug 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Spiking Neural Networks (SNNs) are attractive for resource-constrained remote-sensing systems, but reliable out-of-distribution (OOD) detection remains challenging. Deep ensembles provide strong predictive uncertainty, yet require multiple complete models and backbone evaluations. We propose an efficient spiking pseudo-ensemble that attaches multiple lightweight classification heads to a frozen SNN backbone. Naively training these heads with cross-entropy can lead to diversity collapse, where independently parameterized heads may produce correlated predictions. To address this, we introduce an agree--disagree objective that preserves correct predictions on clean in-distribution samples while encouraging diversity on structured, uncertainty-inducing transformations of the same inputs. This provides a diversity-promoting training signal without requiring external OOD data. Experiments with Spikformer and ResNet19-SNN on EuroSAT demonstrate consistent improvements over conventionally trained pseudo-ensembles. Using three backbones with five heads each matches or improves upon a five-model deep ensemble on UCM and AID, while requiring approximately 38% fewer parameters and 40% fewer backbone evaluations. These results show that explicit diversity promotion can recover useful ensemble-style uncertainty at substantially lower deployment cost.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 2 Aug 2026.

Builds on

19 of 30 references.

References · 19

  1. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
  2. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
  3. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
  4. 2018Deep Anomaly Detection with Outlier Exposurecited by 939
  5. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 604
  6. 2020BatchEnsemble: An Alternative Approach to Efficient Ensemble and Lifelong Learningcited by 368
  7. 2021Laplace Redux -- Effortless Bayesian Deep Learningcited by 359
  8. 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
  9. 2021Deep Residual Learning in Spiking Neural Networkscited by 326
  10. 2022Spikformer: When Spiking Neural Network Meets Transformercited by 263
  11. 2018SLAYER: Spike Layer Error Reassignment in Timecited by 257
  12. 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 192
7 more
  1. 2020Training independent subnetworks for robust predictioncited by 177
  2. 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 163
  3. 2021Optimal Conversion of Conventional Artificial Neural Networks to Spiking Neural Networkscited by 134
  4. 2020Masksembles for Uncertainty Estimationcited by 88
  5. 2022Agree to Disagree: Diversity through Disagreement for Better Transferabilitycited by 69
  6. 2022Packed-Ensembles for Efficient Uncertainty Estimationcited by 49
  7. 2020Semi-supervised novelty detection using ensembles with regularized disagreementcited by 7

Built on by

Not cited yet.