N-ImageNet: Towards Robust, Fine-Grained Object Recognition with Event Cameras
Not on the map. Why?
Abstract (arXiv)
We introduce N-ImageNet, a large-scale dataset targeted for robust, fine-grained object recognition with event cameras. The dataset is collected using programmable hardware in which an event camera consistently moves around a monitor displaying images from ImageNet. N-ImageNet serves as a challenging benchmark for event-based object recognition, due to its large number of classes and samples. We empirically show that pretraining on N-ImageNet improves the performance of event-based classifiers and helps them learn with few labeled data. In addition, we present several variants of N-ImageNet to test the robustness of event-based classifiers under diverse camera trajectories and severe lighting conditions, and propose a novel event representation to alleviate the performance degradation. To the best of our knowledge, we are the first to quantitatively investigate the consequences caused by various environmental conditions on event-based object recognition algorithms. N-ImageNet and its variants are expected to guide practical implementations for deploying event-based object recognition algorithms in the real world.
Key facts. Cited by 92 papers in the map (data through 14 Oct 2026). Builds on 28 of its 64 references that are in the map. First posted on arXiv 2 Dec 2021.
Builds on
28 of 64 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
- 2015Converting Static Image Datasets to Spiking Neuromorphic Datasets Using Saccadescited by 314
- 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 224
- 2018HATS: Histograms of Averaged Time Surfaces for Robust Event-based Object Classificationcited by 218
- 2019End-to-End Learning of Representations for Asynchronous Event-Based Datacited by 217
- 2016Training Deep Spiking Neural Networks using Backpropagationcited by 205
- 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 200
- 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
16 more
- 2019Video to Events: Recycling Video Datasets for Event Camerascited by 165
- 2020A Large Scale Event-based Detection Dataset for Automotivecited by 109
- 2020Event-based Asynchronous Sparse Convolutional Networkscited by 104
- 2016Phased LSTM: Accelerating Recurrent Network Training for Long or Event-based Sequencescited by 99
- 2018Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networkscited by 97
- 2019Graph-Based Object Classification for Neuromorphic Vision Sensingcited by 85
- 2018Continuous-time Intensity Estimation Using Event Camerascited by 68
- 2020Event Enhanced High-Quality Image Recoverycited by 68
- 2020Temporal Binary Representation for Event-Based Action Recognitioncited by 51
- 2015HFirst: A Temporal Approach to Object Recognitioncited by 50
- 2020EventSR: From Asynchronous Events to Image Reconstruction, Restoration, and Super-Resolution via End-to-End Adversarial Learningcited by 40
- 2020v2e: From Video Frames to Realistic DVS Eventscited by 24
- 2020Convolutional Spiking Neural Networks for Spatio-Temporal Feature Extractioncited by 23
- 2018PRED18: Dataset and Further Experiments with DAVIS Event Camera in Predator-Prey Robot Chasingcited by 7
- 2020Unsupervised Feature Learning for Event Data: Direct vs Inverse Problem Formulationcited by 3
- 2020Sparse Convolutions on Continuous Domains for Point Cloud and Event Stream Networkscited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 6; 2023: 16; 2024: 25; 2025: 29; 2026: 15.
92 papers.
Sort:
By area:
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2024Recent Event Camera Innovations: A Surveycited by 68
- 2023DFormer: Rethinking RGBD Representation Learning for Semantic Segmentationcited by 60
- 2022Ev-NeRF: Event Based Neural Radiance Fieldcited by 59
- 2023From Chaos Comes Order: Ordering Event Representations for Object Recognition and Detectioncited by 52
- 2021E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognitioncited by 50
- 2023Event Camera Data Pre-trainingcited by 50
- 2024UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them Allcited by 49
- 2022HARDVS: Revisiting Human Activity Recognition with Dynamic Vision Sensorscited by 47
- 2022Masked Event Modeling: Self-Supervised Pretraining for Event Camerascited by 41
- 2024OpenESS: Event-based Semantic Scene Understanding with Open Vocabulariescited by 38
- 2023EventCLIP: Adapting CLIP for Event-based Object Recognitioncited by 36
38 more
- 2023EventBind: Learning a Unified Representation to Bind Them All for Event-based Open-world Understandingcited by 34
- 2023Label-Free Event-based Object Recognition via Joint Learning with Image Reconstruction from Eventscited by 28
- 2024EventGPT: Event Stream Understanding with Multimodal Large Language Modelscited by 28
- 2022Ev-TTA: Test-Time Adaptation for Event-Based Object Recognitioncited by 26
- 2023Event Camera Data Dense Pre-trainingcited by 21
- 2024OmniBind: Teach to Build Unequal-Scale Modality Interaction for Omni-Bind of Allcited by 20
- 2025UCF-Crime-DVS: A Novel Event-Based Dataset for Video Anomaly Detection with Spiking Neural Networkscited by 19
- 2023Neuromorphic Event-based Facial Expression Recognitioncited by 18
- 2024DailyDVS-200: A Comprehensive Benchmark Dataset for Event-Based Action Recognitioncited by 17
- 2023Enhancing Traffic Object Detection in Variable Illumination with RGB-Event Fusioncited by 16
- 2024Motion-aware Latent Diffusion Models for Video Frame Interpolationcited by 14
- 2025EventVL: Understand Event Streams via Multimodal Large Language Modelcited by 13
- 2022Bina-Rep Event Frames: a Simple and Effective Representation for Event-based camerascited by 12
- 2024Event Stream based Human Action Recognition: A High-Definition Benchmark Dataset and Algorithmscited by 12
- 2024EventSplat: 3D Gaussian Splatting from Moving Event Cameras for Real-time Renderingcited by 12
- 2023EventTransAct: A video transformer-based framework for Event-camera based action recognitioncited by 11
- 2024SpikMamba: When SNN meets Mamba in Event-based Human Action Recognitioncited by 10
- 2025EventFly: Event Camera Perception from Ground to the Skycited by 10
- 2024Data-efficient Event Camera Pre-training via Disentangled Masked Modelingcited by 9
- 2024Towards Robust Event-based Networks for Nighttime via Unpaired Day-to-Night Event Translationcited by 9
- 2023Neuromorphic High-Frequency 3D Dancing Pose Estimation in Dynamic Environmentcited by 8
- 2023Optimising Event-Driven Spiking Neural Network with Regularisation and Cutoffcited by 8
- 2024EZSR: Event-based Zero-Shot Recognitioncited by 8
- 2024Spiking Neural Network as Adaptive Event Stream Slicercited by 8
- 2024ADV2E: Bridging the Gap Between Analogue Circuit and Discrete Frames in the Video-to-Events Simulatorcited by 8
- 2024EventRPG: Event Data Augmentation with Relevance Propagation Guidancecited by 7
- 2024Noise2Image: Noise-Enabled Static Scene Recovery for Event Camerascited by 7
- 2025Event Quality Score (EQS): Assessing the Realism of Simulated Event Camera Streams via Distances in Latent Spacecited by 7
- 2022Privacy-Preserving Visual Localization with Event Camerascited by 6
- 2025Talk2Event: Grounded Understanding of Dynamic Scenes from Event Camerascited by 6
- 2025Beyond conventional vision: RGB-event fusion for robust object detection in dynamic traffic scenarioscited by 6
- 2024CEIA: CLIP-Based Event-Image Alignment for Open-World Event-Based Understandingcited by 5
- 2025LLaFEA: Frame-Event Complementary Fusion for Fine-Grained Spatiotemporal Understanding in LMMscited by 5
- 2025Event-Priori-Based Vision-Language Model for Efficient Visual Understandingcited by 5
- 2025OmniSegmentor: A Flexible Multi-Modal Learning Framework for Semantic Segmentationcited by 5
- 2025CM3AE: A Unified RGB Frame and Event-Voxel/-Frame Pre-training Frameworkcited by 4
- 2026Generative Event Pretraining with Foundation Model Alignmentcited by 4
- 2023RN-Net: Reservoir Nodes-Enabled Neuromorphic Vision Sensing Networkcited by 3
50 most cited of 92 All 92 (JSON)
- 2026Event Cameras for Melt-Pool Monitoring in Additive Manufacturing: A Benchmark and a Cross-Machine Transfer Analysis3 Oct 2026
- 2026Vmem-varphi: Low-Compute Out-of-Distribution Detection in Spiking Neural Networks from Membrane-Potential Statistics29 Sep 2026
- 2026The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation24 Sep 2026
- 2026Multi-viewpoint Geo-localization with Event Cameras18 Sep 2026
- 2026Pedestrian Crossing Intent Classification From Event-Based Vision Using Convolutional Spiking Neural Networks With Temporal Augmentation11 Sep 2026
- 2026Cooking beyond Frames: A Stereo Event Camera Dataset in the Kitchen5 Aug 2026
- 2026Neuromorphic Object Detection: An In-Depth Study and Future Directions26 Jul 2026
- 2026GoStop: Reinforcement Learning for Adaptive Temporal Aggregation in Event-Based Feature Tracking17 Jul 2026
- 2026Weaving Light and Time: Unified Harmonic-Geometric Representation Learning for Dense RGB-Event Parsing10 Jul 2026
- 2026Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model28 Jun 2026
- 2026EventDrive: Event Cameras for Vision-Language Driving Intelligence16 Jun 2026
- 2026Learning to See through Illumination Extremes with Event Streaming in Multimodal Large Language Models29 Mar 2026
38 more
- 2026Generative Event Pretraining with Foundation Model Alignment24 Mar 2026
- 2026LAND: A Longitudinal Analysis of Neuromorphic Datasets17 Feb 2026
- 2026EventFlash: Towards Efficient MLLMs for Event-Based Vision3 Feb 2026
- 2025Reconstruction as a Bridge for Event-Based Visual Question Answering12 Dec 2025
- 2025CS3D: An Efficient Facial Expression Recognition via Event Vision10 Dec 2025
- 2025Learning to Remove Lens Flare in Event Camera9 Dec 2025
- 2025EventBench: Towards Comprehensive Benchmarking of Event-based MLLMs23 Nov 2025
- 2025I2E: Real-Time Image-to-Event Conversion for High-Performance Spiking Neural Networks11 Nov 2025
- 2025MoCom: Motion-based Inter-MAV Visual Communication Using Event Vision and Spiking Neural Networks16 Oct 2025
- 2025ControlEvents: Controllable Synthesis of Event Camera Datawith Foundational Prior from Image Diffusion Models26 Sep 2025
- 2025OmniSegmentor: A Flexible Multi-Modal Learning Framework for Semantic Segmentation18 Sep 2025
- 2025Visual Grounding from Event Cameras11 Sep 2025
- 2025Raw2Event: Converting Raw Frame Camera into Event Camera8 Sep 2025
- 2025Beyond conventional vision: RGB-event fusion for robust object detection in dynamic traffic scenarios14 Aug 2025
- 2025LET-US: Long Event-Text Understanding of Scenes10 Aug 2025
- 2025Revealing Latent Information: A Physics-inspired Self-supervised Pre-training Framework for Noisy and Sparse Events7 Aug 2025
- 2025evTransFER: A Transfer Learning Framework for Event-based Facial Expression Recognition5 Aug 2025
- 2025OmniEvent: Unified Event Representation Learning3 Aug 2025
- 2025Talk2Event: Grounded Understanding of Dynamic Scenes from Event Cameras23 Jul 2025
- 2025Edge Intelligence with Spiking Neural Networks18 Jul 2025
- 2025Event-Priori-Based Vision-Language Model for Efficient Visual Understanding9 Jun 2025
- 2025Learning from Noise: Enhancing DNNs for Event-Based Vision through Controlled Noise Injection4 Jun 2025
- 2025CM3AE: A Unified RGB Frame and Event-Voxel/-Frame Pre-training Framework17 Apr 2025
- 2025Event Quality Score (EQS): Assessing the Realism of Simulated Event Camera Streams via Distances in Latent Space16 Apr 2025
- 2025Human Activity Recognition using RGB-Event based Sensors: A Multi-modal Heat Conduction Model and A Benchmark Dataset8 Apr 2025
- 2025EventFly: Event Camera Perception from Ground to the Sky25 Mar 2025
- 2025Event-Based Crossing Dataset (EBCD)21 Mar 2025
- 2025UCF-Crime-DVS: A Novel Event-Based Dataset for Video Anomaly Detection with Spiking Neural Networks17 Mar 2025
- 2025Helios 2.0: A Robust, Ultra-Low Power Gesture Recognition System Optimised for Event-Sensor based Wearables10 Mar 2025
- 2025LLaFEA: Frame-Event Complementary Fusion for Fine-Grained Spatiotemporal Understanding in LMMs10 Mar 2025
- 2025LLM-EvRep: Learning an LLM-Compatible Event Representation Using a Self-Supervised Framework20 Feb 2025
- 2025EventVL: Understand Event Streams via Multimodal Large Language Model23 Jan 2025
- 2024EventSplat: 3D Gaussian Splatting from Moving Event Cameras for Real-time Rendering10 Dec 2024
- 2024Expanding Event Modality Applications through a Robust CLIP-Based Encoder4 Dec 2024
- 2024EventGPT: Event Stream Understanding with Multimodal Large Language Models1 Dec 2024
- 2024Event USKT : U-State Space Model in Knowledge Transfer for Event Cameras22 Nov 2024
- 2024ADV2E: Bridging the Gap Between Analogue Circuit and Discrete Frames in the Video-to-Events Simulator19 Nov 2024
- 2024SpikMamba: When SNN meets Mamba in Event-based Human Action Recognition22 Oct 2024
50 newest of 92 All 92 (JSON)
- 2023EventCLIP: Adapting CLIP for Event-based Object Recognitioncited by 36
- 2023EventBind: Learning a Unified Representation to Bind Them All for Event-based Open-world Understandingcited by 34
- 2024EventGPT: Event Stream Understanding with Multimodal Large Language Modelscited by 28
- 2025EventVL: Understand Event Streams via Multimodal Large Language Modelcited by 13
- 2025Event-Priori-Based Vision-Language Model for Efficient Visual Understandingcited by 5
- 2026EventFlash: Towards Efficient MLLMs for Event-Based Visioncited by 3
- 2025EventBench: Towards Comprehensive Benchmarking of Event-based MLLMscited by 1
- 2025Reconstruction as a Bridge for Event-Based Visual Question Answeringcited by 0
- 2026EventFlash: Towards Efficient MLLMs for Event-Based Vision3 Feb 2026
- 2025Reconstruction as a Bridge for Event-Based Visual Question Answering12 Dec 2025
- 2025EventBench: Towards Comprehensive Benchmarking of Event-based MLLMs23 Nov 2025
- 2025Event-Priori-Based Vision-Language Model for Efficient Visual Understanding9 Jun 2025
- 2025EventVL: Understand Event Streams via Multimodal Large Language Model23 Jan 2025
- 2024EventGPT: Event Stream Understanding with Multimodal Large Language Models1 Dec 2024
- 2023EventBind: Learning a Unified Representation to Bind Them All for Event-based Open-world Understanding6 Aug 2023
- 2023EventCLIP: Adapting CLIP for Event-based Object Recognition10 Jun 2023
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2024Recent Event Camera Innovations: A Surveycited by 68
- 2023DFormer: Rethinking RGBD Representation Learning for Semantic Segmentationcited by 60
- 2022Ev-NeRF: Event Based Neural Radiance Fieldcited by 59
- 2023From Chaos Comes Order: Ordering Event Representations for Object Recognition and Detectioncited by 52
- 2021E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognitioncited by 50
- 2023Event Camera Data Pre-trainingcited by 50
- 2024UniBind: LLM-Augmented Unified and Balanced Representation Space to Bind Them Allcited by 49
- 2022HARDVS: Revisiting Human Activity Recognition with Dynamic Vision Sensorscited by 47
- 2022Masked Event Modeling: Self-Supervised Pretraining for Event Camerascited by 41
- 2024OpenESS: Event-based Semantic Scene Understanding with Open Vocabulariescited by 38
- 2023Label-Free Event-based Object Recognition via Joint Learning with Image Reconstruction from Eventscited by 28
12 most cited of 75 All 75 (JSON)
- 2026Event Cameras for Melt-Pool Monitoring in Additive Manufacturing: A Benchmark and a Cross-Machine Transfer Analysis3 Oct 2026
- 2026Vmem-varphi: Low-Compute Out-of-Distribution Detection in Spiking Neural Networks from Membrane-Potential Statistics29 Sep 2026
- 2026The Shape of Events: Edge-Based Inductive Biases via Cross-Domain Distillation24 Sep 2026
- 2026Multi-viewpoint Geo-localization with Event Cameras18 Sep 2026
- 2026Pedestrian Crossing Intent Classification From Event-Based Vision Using Convolutional Spiking Neural Networks With Temporal Augmentation11 Sep 2026
- 2026Cooking beyond Frames: A Stereo Event Camera Dataset in the Kitchen5 Aug 2026
- 2026Neuromorphic Object Detection: An In-Depth Study and Future Directions26 Jul 2026
- 2026Weaving Light and Time: Unified Harmonic-Geometric Representation Learning for Dense RGB-Event Parsing10 Jul 2026
- 2026Generative Event Pretraining with Foundation Model Alignment24 Mar 2026
- 2026LAND: A Longitudinal Analysis of Neuromorphic Datasets17 Feb 2026
- 2025CS3D: An Efficient Facial Expression Recognition via Event Vision10 Dec 2025
- 2025Learning to Remove Lens Flare in Event Camera9 Dec 2025
12 newest of 75 All 75 (JSON)