Real-Time Intensity-Image Reconstruction for Event Cameras Using Manifold Regularisation
Not on the map. Why?
Abstract (arXiv)
Event cameras or neuromorphic cameras mimic the human perception system as they measure the per-pixel intensity change rather than the actual intensity level. In contrast to traditional cameras, such cameras capture new information about the scene at MHz frequency in the form of sparse events. The high temporal resolution comes at the cost of losing the familiar per-pixel intensity information. In this work we propose a variational model that accurately models the behaviour of event cameras, enabling reconstruction of intensity images with arbitrary frame rate in real-time. Our method is formulated on a per-event-basis, where we explicitly incorporate information about the asynchronous nature of events via an event manifold induced by the relative timestamps of events. In our experiments we verify that solving the variational model on the manifold produces high-quality images without explicitly estimating optical flow.
Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Jul 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 6; 2023: 14; 2024: 12; 2025: 10; 2026: 5.
49 papers.
Sort:
By area:
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2022ESS: Learning Event-based Semantic Segmentation from Still Imagescited by 81
- 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 58
- 2023Graph-based Asynchronous Event Processing for Rapid Object Recognitioncited by 51
- 2022TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolationcited by 37
- 2023HyperE2VID: Improving Event-Based Video Reconstruction via Hypernetworkscited by 37
- 2024Seeing Motion at Nighttime with an Event Cameracited by 33
- 2021Formulating Event-based Image Reconstruction as a Linear Inverse Problem with Deep Regularization using Optical Flowcited by 28
- 2023Label-Free Event-based Object Recognition via Joint Learning with Image Reconstruction from Eventscited by 28
- 2023EVREAL: Towards a Comprehensive Benchmark and Analysis Suite for Event-based Video Reconstructioncited by 24
- 2023EventAid: Benchmarking Event-aided Image/Video Enhancement Algorithms with Real-captured Hybrid Datasetcited by 19
- 2023EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fieldscited by 17
37 more
- 2023Person Re-Identification without Identification via Event Anonymizationcited by 16
- 2023Event-based Continuous Color Video Decompression from Single Framescited by 14
- 2023Event-guided Multi-patch Network with Self-supervision for Non-uniform Motion Deblurringcited by 13
- 2023Learning to Super-Resolve Blurry Images with Eventscited by 10
- 2024Temporal Residual Guided Diffusion Framework for Event-Driven Video Reconstructioncited by 10
- 2025Unsupervised Joint Learning of Optical Flow and Intensity with Event Camerascited by 10
- 2023E-Calib: A Fast, Robust and Accurate Calibration Toolbox for Event Camerascited by 9
- 2024Temporal-Mapping Photography for Event Camerascited by 9
- 2022Autofocus for Event Camerascited by 7
- 2024Generalized Event Camerascited by 7
- 2024E2VIDiff: Perceptual Events-to-Video Reconstruction using Diffusion Priorscited by 7
- 2025Binarized Mamba-Transformer for Lightweight Quad Bayer HybridEVS Demosaicingcited by 7
- 2022Learning to See Through with Eventscited by 6
- 2023An Asynchronous Linear Filter Architecture for Hybrid Event-Frame Camerascited by 6
- 2025EventMamba: Enhancing Spatio-Temporal Locality with State Space Models for Event-Based Video Reconstructioncited by 6
- 2021Research on Event Accumulator Settings for Event-Based SLAMcited by 5
- 2023An Asynchronous Intensity Representation for Framed and Event Video Sourcescited by 5
- 2024LaSe-E2V: Towards Language-guided Semantic-Aware Event-to-Video Reconstructioncited by 5
- 2024Revisit Event Generation Model: Self-Supervised Learning of Event-to-Video Reconstruction with Implicit Neural Representationscited by 4
- 2025Creating and Evaluating Personas Using Generative AI: A Scoping Review of 81 Articlescited by 4
- 2024Event Cameras Meet SPADs for High-Speed, Low-Bandwidth Imagingcited by 3
- 2025Event Camera Guided Visual Media Restoration & 3D Reconstruction: A Surveycited by 3
- 2024Fourier-based Action Recognition for Wildlife Behavior Quantification with Event Camerascited by 2
- 2026Event6D: Event-based Novel Object 6D Pose Trackingcited by 2
- 2022Illumination-Based Color Reconstruction for the Dynamic Vision Sensorcited by 1
- 2024Enhanced Event-Based Video Reconstruction with Motion Compensationcited by 1
- 2024High-speed and High-quality Vision Reconstruction of Spike Camera with Spike Stability Theoremcited by 1
- 2025EMF: Event Meta Formers for Event-based Real-time Traffic Object Detectioncited by 1
- 2026Optical Linear Systems Framework for Event Sensing and Computational Neuromorphic Imagingcited by 1
- 2026UniE2F: A Unified Diffusion Framework for Event-to-Frame Reconstruction with Video Foundation Modelscited by 1
- 2024EROAM: Event-based Camera Rotational Odometry and Mapping in Real-timecited by 0
- 2025PS-EIP: Robust Photometric Stereo Based on Event Interval Profilecited by 0
- 2025UTA-Sign: Unsupervised Thermal Video Augmentation via Event-Assisted Traffic Signage Sketchingcited by 0
- 2025Filter-Based Reconstruction of Images from Eventscited by 0
- 2025EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Modelscited by 0
- 2026Programmable Silicon Retina on Pixel Processor Arraycited by 0
- 2026LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Modelscited by 0
- 2026LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models9 Jul 2026
- 2026Programmable Silicon Retina on Pixel Processor Array6 Jun 2026
- 2026Event6D: Event-based Novel Object 6D Pose Tracking30 Mar 2026
- 2026UniE2F: A Unified Diffusion Framework for Event-to-Frame Reconstruction with Video Foundation Models22 Feb 2026
- 2026Optical Linear Systems Framework for Event Sensing and Computational Neuromorphic Imaging20 Jan 2026
- 2025EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Models21 Nov 2025
- 2025Filter-Based Reconstruction of Images from Events22 Oct 2025
- 2025Event Camera Guided Visual Media Restoration & 3D Reconstruction: A Survey12 Sep 2025
- 2025UTA-Sign: Unsupervised Thermal Video Augmentation via Event-Assisted Traffic Signage Sketching28 Aug 2025
- 2025Creating and Evaluating Personas Using Generative AI: A Scoping Review of 81 Articles7 Apr 2025
- 2025EMF: Event Meta Formers for Event-based Real-time Traffic Object Detection5 Apr 2025
- 2025EventMamba: Enhancing Spatio-Temporal Locality with State Space Models for Event-Based Video Reconstruction25 Mar 2025
37 more
- 2025PS-EIP: Robust Photometric Stereo Based on Event Interval Profile24 Mar 2025
- 2025Unsupervised Joint Learning of Optical Flow and Intensity with Event Cameras21 Mar 2025
- 2025Binarized Mamba-Transformer for Lightweight Quad Bayer HybridEVS Demosaicing20 Mar 2025
- 2024High-speed and High-quality Vision Reconstruction of Spike Camera with Spike Stability Theorem16 Dec 2024
- 2024EROAM: Event-based Camera Rotational Odometry and Mapping in Real-time17 Nov 2024
- 2024Fourier-based Action Recognition for Wildlife Behavior Quantification with Event Cameras9 Oct 2024
- 2024Revisit Event Generation Model: Self-Supervised Learning of Event-to-Video Reconstruction with Implicit Neural Representations26 Jul 2024
- 2024Temporal Residual Guided Diffusion Framework for Event-Driven Video Reconstruction15 Jul 2024
- 2024E2VIDiff: Perceptual Events-to-Video Reconstruction using Diffusion Priors11 Jul 2024
- 2024LaSe-E2V: Towards Language-guided Semantic-Aware Event-to-Video Reconstruction8 Jul 2024
- 2024Generalized Event Cameras2 Jul 2024
- 2024Seeing Motion at Nighttime with an Event Camera18 Apr 2024
- 2024Event Cameras Meet SPADs for High-Speed, Low-Bandwidth Imaging17 Apr 2024
- 2024Enhanced Event-Based Video Reconstruction with Motion Compensation18 Mar 2024
- 2024Temporal-Mapping Photography for Event Cameras11 Mar 2024
- 2023EventAid: Benchmarking Event-aided Image/Video Enhancement Algorithms with Real-captured Hybrid Dataset13 Dec 2023
- 2023Event-based Continuous Color Video Decompression from Single Frames30 Nov 2023
- 2023EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fields3 Oct 2023
- 2023An Asynchronous Linear Filter Architecture for Hybrid Event-Frame Cameras3 Sep 2023
- 2023Graph-based Asynchronous Event Processing for Rapid Object Recognition28 Aug 2023
- 2023Label-Free Event-based Object Recognition via Joint Learning with Image Reconstruction from Events18 Aug 2023
- 2023Person Re-Identification without Identification via Event Anonymization8 Aug 2023
- 2023E-Calib: A Fast, Robust and Accurate Calibration Toolbox for Event Cameras15 Jun 2023
- 2023HyperE2VID: Improving Event-Based Video Reconstruction via Hypernetworks10 May 2023
- 2023EVREAL: Towards a Comprehensive Benchmark and Analysis Suite for Event-based Video Reconstruction30 Apr 2023
- 2023Learning to Super-Resolve Blurry Images with Events27 Feb 2023
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarks17 Feb 2023
- 2023Event-guided Multi-patch Network with Self-supervision for Non-uniform Motion Deblurring14 Feb 2023
- 2023An Asynchronous Intensity Representation for Framed and Event Video Sources20 Jan 2023
- 2022Learning to See Through with Events5 Dec 2022
- 2022Illumination-Based Color Reconstruction for the Dynamic Vision Sensor12 Nov 2022
- 2022TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolation25 Mar 2022
- 2022Autofocus for Event Cameras23 Mar 2022
- 2022ESS: Learning Event-based Semantic Segmentation from Still Images18 Mar 2022
- 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Network25 Jan 2022
- 2021Formulating Event-based Image Reconstruction as a Linear Inverse Problem with Deep Regularization using Optical Flow12 Dec 2021
- 2021Research on Event Accumulator Settings for Event-Based SLAM1 Dec 2021
- 2024Temporal Residual Guided Diffusion Framework for Event-Driven Video Reconstructioncited by 10
- 2024E2VIDiff: Perceptual Events-to-Video Reconstruction using Diffusion Priorscited by 7
- 2024LaSe-E2V: Towards Language-guided Semantic-Aware Event-to-Video Reconstructioncited by 5
- 2026UniE2F: A Unified Diffusion Framework for Event-to-Frame Reconstruction with Video Foundation Modelscited by 1
- 2025EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Modelscited by 0
- 2026LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Modelscited by 0
- 2026LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models9 Jul 2026
- 2026UniE2F: A Unified Diffusion Framework for Event-to-Frame Reconstruction with Video Foundation Models22 Feb 2026
- 2025EvDiff: Event-Based Video Reconstruction using One-Step Diffusion Models21 Nov 2025
- 2024Temporal Residual Guided Diffusion Framework for Event-Driven Video Reconstruction15 Jul 2024
- 2024E2VIDiff: Perceptual Events-to-Video Reconstruction using Diffusion Priors11 Jul 2024
- 2024LaSe-E2V: Towards Language-guided Semantic-Aware Event-to-Video Reconstruction8 Jul 2024
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2022ESS: Learning Event-based Semantic Segmentation from Still Imagescited by 81
- 2022Event-based Video Reconstruction via Potential-assisted Spiking Neural Networkcited by 58
- 2023Graph-based Asynchronous Event Processing for Rapid Object Recognitioncited by 51
- 2022TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolationcited by 37
- 2023HyperE2VID: Improving Event-Based Video Reconstruction via Hypernetworkscited by 37
- 2024Seeing Motion at Nighttime with an Event Cameracited by 33
- 2021Formulating Event-based Image Reconstruction as a Linear Inverse Problem with Deep Regularization using Optical Flowcited by 28
- 2023Label-Free Event-based Object Recognition via Joint Learning with Image Reconstruction from Eventscited by 28
- 2023EVREAL: Towards a Comprehensive Benchmark and Analysis Suite for Event-based Video Reconstructioncited by 24
- 2023EventAid: Benchmarking Event-aided Image/Video Enhancement Algorithms with Real-captured Hybrid Datasetcited by 19
- 2023EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fieldscited by 17
12 most cited of 41 All 41 (JSON)
- 2026Programmable Silicon Retina on Pixel Processor Array6 Jun 2026
- 2026Event6D: Event-based Novel Object 6D Pose Tracking30 Mar 2026
- 2026Optical Linear Systems Framework for Event Sensing and Computational Neuromorphic Imaging20 Jan 2026
- 2025Filter-Based Reconstruction of Images from Events22 Oct 2025
- 2025Event Camera Guided Visual Media Restoration & 3D Reconstruction: A Survey12 Sep 2025
- 2025UTA-Sign: Unsupervised Thermal Video Augmentation via Event-Assisted Traffic Signage Sketching28 Aug 2025
- 2025Creating and Evaluating Personas Using Generative AI: A Scoping Review of 81 Articles7 Apr 2025
- 2025EMF: Event Meta Formers for Event-based Real-time Traffic Object Detection5 Apr 2025
- 2025PS-EIP: Robust Photometric Stereo Based on Event Interval Profile24 Mar 2025
- 2025Unsupervised Joint Learning of Optical Flow and Intensity with Event Cameras21 Mar 2025
- 2024High-speed and High-quality Vision Reconstruction of Spike Camera with Spike Stability Theorem16 Dec 2024
- 2024EROAM: Event-based Camera Rotational Odometry and Mapping in Real-time17 Nov 2024
12 newest of 41 All 41 (JSON)