mlsanityData to 14 Oct 2026

Adaptive Time-step Training for Enhancing Spike-Based Neural Radiance Fields

arXiv 2507.23033 ↗First posted 30 Jul 2025cs.CV cs.NEcited by 0

Not on the map. Why?

Abstract (arXiv)

Spiking Neural Networks (SNNs) provide an energy-efficient computing paradigm for neural rendering, but existing spike-based Neural Radiance Field (NeRF) models usually use a fixed inference time step for all scenes. This fixed temporal budget is inefficient because NeRF follows a scene-specific training paradigm, and different scenes require different temporal capacities to preserve rendering quality. This paper proposes Pretraining-based Adaptive Time-step Adjustment (PATA), a scene-wise adaptive time-step training framework for spike-based NeRF. PATA parameterizes the target inference time step as a trainable variable and optimizes it through a two-stage training process. A hybrid input mode strengthens early time-step outputs, while full-step soft supervision, smoothed rendering loss, and temporal-budget loss jointly maintain rendering fidelity and reduce temporal computation. The learned target time step is shared by all ray samples within a scene, preserving the parallel rendering structure of NeRF. Experiments on INGP-NeRF and TensoRF backbones across Synthetic-NeRF, Mip-NeRF 360, and LLFF show that PATA consistently reduces inference cost while maintaining competitive rendering quality. PATA reduces the estimated inference energy by up to 57.57% on INGP-NeRF and 68.90% on TensoRF, demonstrating its effectiveness across different neural rendering representations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 68 references that are in the map. First posted on arXiv 30 Jul 2025.

Builds on

45 of 68 references.

References · 45

  1. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  2. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  3. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  4. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  5. 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
  6. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  7. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  8. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
  9. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
  10. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
  11. 2017Spatio-Temporal Backpropagation for Training High-performance Spiking Neural Networkscited by 406
  12. 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 345
33 more
  1. 2018Deep Learning in Spiking Neural Networkscited by 263
  2. 2022Temporal Efficient Training of Spiking Neural Network via Gradient Re-weightingcited by 198
  3. 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 169
  4. 2022Variable Bitrate Neural Fieldscited by 117
  5. 2021Accurate and efficient time-domain classification with adaptive spiking recurrent neural networkscited by 115
  6. 2022GLIF: A Unified Gated Leaky Integrate-and-Fire Neuron for Spiking Neural Networkscited by 63
  7. 2023SEENN: Towards Temporal Spiking Early-Exit Neural Networkscited by 41
  8. 2023Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependenciescited by 41
  9. 2024Binary Opacity Grids: Capturing Fine Geometric Detail for Mesh-Based View Synthesiscited by 41
  10. 2023Binary Radiance Fieldscited by 40
  11. 2024SpikingResformer: Bridging ResNet and Vision Transformer in Spiking Neural Networkscited by 40
  12. 2021Recursive-NeRF: An Efficient and Dynamically Growing NeRFcited by 32
  13. 2023SHACIRA: Scalable HAsh-grid Compression for Implicit Neural Representationscited by 31
  14. 2024How Far Can We Compress Instant-NGP-Based NeRF?cited by 30
  15. 2022Exploring Temporal Information Dynamics in Spiking Neural Networkscited by 24
  16. 2023High-performance deep spiking neural networks with 0.3 spikes per neuroncited by 22
  17. 2023TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential Modellingcited by 21
  18. 2023HollowNeRF: Pruning Hashgrid-Based NeRFs with Trainable Collision Mitigationcited by 16
  19. 2023Unleashing the Potential of Spiking Neural Networks by Dynamic Confidencecited by 15
  20. 2024Is Vanilla MLP in Neural Radiance Field Enough for Few-shot View Synthesis?cited by 15
  21. 2023Input-Aware Dynamic Timestep Spiking Neural Networks for Efficient In-Memory Computingcited by 11
  22. 2021Can Deep Neural Networks be Converted to Ultra Low-Latency Spiking Neural Networks?cited by 9
  23. 2024Self-Distillation Learning Based on Temporal-Spatial Consistency for Spiking Neural Networkscited by 9
  24. 2024Towards Low-latency Event-based Visual Recognition with Hybrid Step-wise Distillation Spiking Neural Networkscited by 8
  25. 2025DA-LIF: Dual Adaptive Leaky Integrate-and-Fire Model for Deep Spiking Neural Networkscited by 8
  26. 2023Efficient Deep Spiking Multi-Layer Perceptrons with Multiplication-Free Inferencecited by 7
  27. 2024Content-Aware Radiance Fields: Aligning Model Complexity with Scene Intricacy Through Learned Bitwidth Quantizationcited by 7
  28. 2023SpikingNeRF: Making Bio-inspired Neural Networks See through the Real Worldcited by 6
  29. 2023Spiking NeRF: Representing the Real-World Geometry by a Discontinuous Representationcited by 6
  30. 2024Spike-NeRF: Neural Radiance Field Based On Spike Cameracited by 6
  31. 2024Sharpening Your Density Fields: Spiking Neuron Aided Fast Geometry Learningcited by 2
  32. 2025Towards Efficient and Accurate Spiking Neural Networks via Adaptive Bit Allocationcited by 2
  33. 2024G-NeLF: Memory- and Data-Efficient Hybrid Neural Light Field for Novel View Synthesiscited by 1

Built on by

Not cited yet.