mlsanityData to 14 Oct 2026

The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation

arXiv 2609.30478 ↗First posted 24 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Convolutional neural networks trained on ImageNet are known to exhibit a strong preference for local high-frequency texture, an inductive bias that translates into fragile robustness against distribution shifts in real-world environments. Event cameras, in contrast, record only changes in scene brightness and are therefore well suited to capturing contour information; however, due to the absence of diagnostic benchmarks in the event domain, the inductive bias that event-camera data instills in vision models has remained underexplored. In this work, we use knowledge distillation from the event domain to the RGB domain so as to exploit the rich evaluation toolkit available in the RGB domain and systematically dissect this inductive bias. Our experiments show that distillation from the event domain induces, in the RGB domain, color invariance, shape bias, and robustness to high-frequency noise. We identify the underlying mechanism as the model suppressing its dependence on high-frequency texture while acquiring a stronger dependence on edge-based object shape. This hypothesis is supported by changes in how color and spatial information are processed at the early layers, together with a spectral trade-off in which robustness to the absence of high-frequency components coexists with vulnerability to contamination of the relied-upon frequency bands and to disruption of geometric structure. We further show that this inductive bias differs from existing robustification methods and that it functions as a useful prior for diverse downstream tasks in which shape and contour information contribute alongside other cues. The code is available at https://github.com/snskysk/event2rgb-distillation .

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 71 of its 99 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

71 of 99 references.

References · 71

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  6. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  7. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  8. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  9. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  10. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  11. 2022A ConvNet for the 2020scited by 3,579
  12. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
38 more
  1. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
  2. 2013Visualizing and Understanding Convolutional Networkscited by 2,290
  3. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  4. 2014FitNets: Hints for Thin Deep Netscited by 1,653
  5. 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,451
  6. 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
  7. 2016Understanding intermediate layers using linear classifier probescited by 1,353
  8. 2017Random Erasing Data Augmentationcited by 1,239
  9. 2019Event-based Vision: A Surveycited by 1,016
  10. 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,013
  11. 2019Relational Knowledge Distillationcited by 889
  12. 2018Robustness May Be at Odds with Accuracycited by 880
  13. 2019Contrastive Representation Distillationcited by 748
  14. 2021Intriguing Properties of Vision Transformerscited by 446
  15. 2015Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccadescited by 314
  16. 2022How Do Vision Transformers Work?cited by 307
  17. 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
  18. 2019Approximating CNNs with Bag-of-local-Features models works surprisingly well on ImageNetcited by 260
  19. 2021Knowledge distillation: A good teacher is patient and consistentcited by 259
  20. 2016SoundNet: Learning Sound Representations from Unlabeled Videocited by 247
  21. 2018Generalisation in humans and deep neural networkscited by 237
  22. 2018HATS: Histograms of Averaged Time Surfaces for Robust Event-based Object Classificationcited by 218
  23. 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
  24. 2021Partial success in closing the gap between human and machine visioncited by 185
  25. 2015Cross Modal Distillation for Supervision Transfercited by 175
  26. 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 159
  27. 2018EV-SegNet: Semantic Segmentation for Event-based Camerascited by 93
  28. 2021N-ImageNet: Towards Robust, Fine-Grained Object Recognition with Event Camerascited by 92
  29. 2018Semantic Adversarial Examplescited by 86
  30. 2019Graph-Based Object Classification for Neuromorphic Vision Sensingcited by 85
  31. 2018Modality Distillation with Multiple Stream Networks for Action Recognitioncited by 83
  32. 2022ESS: Learning Event-based Semantic Segmentation from Still Imagescited by 82
  33. 2020Shape-Texture Debiased Neural Network Trainingcited by 76
  34. 2024State Space Models for Event Camerascited by 75
  35. 2021Shape or Texture: Understanding Discriminative Features in CNNscited by 52
  36. 2023From Chaos Comes Order: Ordering Event Representations for Object Recognition and Detectioncited by 52
  37. 2023Event Camera Data Pre-trainingcited by 50
  38. 2021EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillationcited by 47

50 most cited of 71 All 71 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025HAD: Hierarchical Asymmetric Distillation to Bridge Spatio-Temporal Gaps in Event-Based Object Tracking
  2. 2026EventVGGT: Exploring Cross-Modal Distillation for Consistent Event-based Depth Estimation
  3. 2026SED:Lightweight Saliency prediction for Event-based data via Distillation
  4. 2023Object-centric Cross-modal Feature Distillation for Event-based Object Detection
  5. 2023Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline
  6. 2024EventGPT: Event Stream Understanding with Multimodal Large Language Models
  7. 2026SFE-VGGT: Source-Free VGGT Distillation for Event-Based Monocular Depth Estimation
  8. 2025LET-US: Long Event-Text Understanding of Scenes