mlsanityData to 14 Oct 2026

EventSplat: 3D Gaussian Splatting from Moving Event Cameras for Real-time Rendering

arXiv 2412.07293 ↗First posted 10 Dec 2024cs.CVcited by 12

Not on the map. Why?

Abstract (arXiv)

We introduce a method for using event camera data in novel view synthesis via Gaussian Splatting. Event cameras offer exceptional temporal resolution and a high dynamic range. Leveraging these capabilities allows us to effectively address the novel view synthesis challenge in the presence of fast camera motion. For initialization of the optimization process, our approach uses prior knowledge encoded in an event-to-video model. We also use spline interpolation for obtaining high quality poses along the event camera trajectory. This enhances the reconstruction quality from fast-moving cameras while overcoming the computational limitations traditionally associated with event-based Neural Radiance Field (NeRF) methods. Our experimental evaluation demonstrates that our results achieve higher visual fidelity and better performance than existing event-based NeRF approaches while being an order of magnitude faster to render.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 64 of its 89 references that are in the map. First posted on arXiv 10 Dec 2024.

Builds on

64 of 89 references.

References · 64

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  4. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  6. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  7. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  8. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  9. 2019Event-based Vision: A Surveycited by 1,016
  10. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
  11. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  12. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
38 more
  1. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
  2. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 575
  3. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
  4. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  5. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
  6. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  7. 2023Gaussian Splatting SLAMcited by 415
  8. 2019High Speed and High Dynamic Range Video with an Event Cameracited by 345
  9. 2021NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Imagescited by 336
  10. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 311
  11. 2023Text-to-3D using Gaussian Splattingcited by 299
  12. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  13. 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 224
  14. 2024A Survey on 3D Gaussian Splattingcited by 224
  15. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 221
  16. 2018HATS: Histograms of Averaged Time Surfaces for Robust Event-based Object Classificationcited by 218
  17. 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 218
  18. 2019End-to-End Learning of Representations for Asynchronous Event-Based Datacited by 217
  19. 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
  20. 2021Deblur-NeRF: Neural Radiance Fields from Blurry Imagescited by 179
  21. 2018A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimationcited by 178
  22. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  23. 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 159
  24. 2021E-RAFT: Dense Optical Flow from Event Camerascited by 152
  25. 2021TimeLens: Event-based Video Frame Interpolationcited by 151
  26. 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
  27. 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
  28. 2018Bringing a Blurry Frame Alive at High Frame-Rate with an Event Cameracited by 141
  29. 2018Asynchronous, Photometric Feature Tracking using Events and Framescited by 118
  30. 2022Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusioncited by 111
  31. 2020Event-based Stereo Visual Odometrycited by 105
  32. 2021N-ImageNet: Towards Robust, Fine-Grained Object Recognition with Event Camerascited by 92
  33. 2022Event-aided Direct Sparse Odometrycited by 92
  34. 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Cameracited by 92
  35. 2022E-NeRF: Neural Radiance Fields from a Moving Event Cameracited by 70
  36. 2022AdaNeRF: Adaptive Sampling for Real-time Rendering of Neural Radiance Fieldscited by 68
  37. 2018Semi-Dense 3D Reconstruction with a Stereo Event Cameracited by 67
  38. 2022Ev-NeRF: Event Based Neural Radiance Fieldcited by 59

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 8.

12 papers.