The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation
Not on the map. Why?
Abstract (arXiv)
Convolutional neural networks trained on ImageNet are known to exhibit a strong preference for local high-frequency texture, an inductive bias that translates into fragile robustness against distribution shifts in real-world environments. Event cameras, in contrast, record only changes in scene brightness and are therefore well suited to capturing contour information; however, due to the absence of diagnostic benchmarks in the event domain, the inductive bias that event-camera data instills in vision models has remained underexplored. In this work, we use knowledge distillation from the event domain to the RGB domain so as to exploit the rich evaluation toolkit available in the RGB domain and systematically dissect this inductive bias. Our experiments show that distillation from the event domain induces, in the RGB domain, color invariance, shape bias, and robustness to high-frequency noise. We identify the underlying mechanism as the model suppressing its dependence on high-frequency texture while acquiring a stronger dependence on edge-based object shape. This hypothesis is supported by changes in how color and spatial information are processed at the early layers, together with a spectral trade-off in which robustness to the absence of high-frequency components coexists with vulnerability to contamination of the relied-upon frequency bands and to disruption of geometric structure. We further show that this inductive bias differs from existing robustification methods and that it functions as a useful prior for diverse downstream tasks in which shape and contour information contribute alongside other cues. The code is available at https://github.com/snskysk/event2rgb-distillation .
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 71 of its 99 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
71 of 99 references.
References · 71
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2022A ConvNet for the 2020scited by 3,579
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
38 more
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2020Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attackscited by 1,451
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2017Random Erasing Data Augmentationcited by 1,239
- 2019Event-based Vision: A Surveycited by 1,016
- 2019Learning Robust Global Representations by Penalizing Local Predictive Powercited by 1,013
- 2019Relational Knowledge Distillationcited by 889
- 2018Robustness May Be at Odds with Accuracycited by 880
- 2019Contrastive Representation Distillationcited by 748
- 2021Intriguing Properties of Vision Transformerscited by 446
- 2015Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccadescited by 314
- 2022How Do Vision Transformers Work?cited by 307
- 2019A Fourier Perspective on Model Robustness in Computer Visioncited by 288
- 2019Approximating CNNs with Bag-of-local-Features models works surprisingly well on ImageNetcited by 260
- 2021Knowledge distillation: A good teacher is patient and consistentcited by 259
- 2016SoundNet: Learning Sound Representations from Unlabeled Videocited by 247
- 2018Generalisation in humans and deep neural networkscited by 237
- 2018HATS: Histograms of Averaged Time Surfaces for Robust Event-based Object Classificationcited by 218
- 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
- 2021Partial success in closing the gap between human and machine visioncited by 185
- 2015Cross Modal Distillation for Supervision Transfercited by 175
- 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 159
- 2018EV-SegNet: Semantic Segmentation for Event-based Camerascited by 93
- 2021N-ImageNet: Towards Robust, Fine-Grained Object Recognition with Event Camerascited by 92
- 2018Semantic Adversarial Examplescited by 86
- 2019Graph-Based Object Classification for Neuromorphic Vision Sensingcited by 85
- 2018Modality Distillation with Multiple Stream Networks for Action Recognitioncited by 83
- 2022ESS: Learning Event-based Semantic Segmentation from Still Imagescited by 82
- 2020Shape-Texture Debiased Neural Network Trainingcited by 76
- 2024State Space Models for Event Camerascited by 75
- 2021Shape or Texture: Understanding Discriminative Features in CNNscited by 52
- 2023From Chaos Comes Order: Ordering Event Representations for Object Recognition and Detectioncited by 52
- 2023Event Camera Data Pre-trainingcited by 50
- 2021EvDistill: Asynchronous Events to End-task Learning via Bidirectional Reconstruction-guided Cross-modal Knowledge Distillationcited by 47
50 most cited of 71 All 71 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025HAD: Hierarchical Asymmetric Distillation to Bridge Spatio-Temporal Gaps in Event-Based Object Tracking
- 2026EventVGGT: Exploring Cross-Modal Distillation for Consistent Event-based Depth Estimation
- 2026SED:Lightweight Saliency prediction for Event-based data via Distillation
- 2023Object-centric Cross-modal Feature Distillation for Event-based Object Detection
- 2023Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline
- 2024EventGPT: Event Stream Understanding with Multimodal Large Language Models
- 2026SFE-VGGT: Source-Free VGGT Distillation for Event-Based Monocular Depth Estimation
- 2025LET-US: Long Event-Text Understanding of Scenes