EVOS: Efficient Implicit Neural Training via EVOlutionary Selector
Not on the map. Why?
Abstract (arXiv)
We propose EVOlutionary Selector (EVOS), an efficient training paradigm for accelerating Implicit Neural Representation (INR). Unlike conventional INR training that feeds all samples through the neural network in each iteration, our approach restricts training to strategically selected points, reducing computational overhead by eliminating redundant forward passes. Specifically, we treat each sample as an individual in an evolutionary process, where only those fittest ones survive and merit inclusion in training, adaptively evolving with the neural network dynamics. While this is conceptually similar to Evolutionary Algorithms, their distinct objectives (selection for acceleration vs. iterative solution optimization) require a fundamental redefinition of evolutionary mechanisms for our context. In response, we design sparse fitness evaluation, frequency-guided crossover, and augmented unbiased mutation to comprise EVOS. These components respectively guide sample selection with reduced computational cost, enhance performance through frequency-domain balance, and mitigate selection bias from cached evaluation. Extensive experiments demonstrate that our method achieves approximately 48%-66% reduction in training time while ensuring superior convergence without additional cost, establishing state-of-the-art acceleration among recent sampling-based strategies.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 46 of its 67 references that are in the map. First posted on arXiv 13 Dec 2024.
Builds on
46 of 67 references.
References · 46
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2020Neural Sparse Voxel Fieldscited by 959
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 467
34 more
- 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
- 2014Identifying and attacking the saddle point problem in high-dimensional non-convex optimizationcited by 289
- 2021NeRV: Neural Representations for Videoscited by 256
- 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 242
- 2021COIN: COmpression with Implicit Neural representationscited by 233
- 2023WIRE: Wavelet Implicit Neural Representationscited by 220
- 2022From data to functa: Your data point is a function and you can treat it like onecited by 187
- 2021Implicit Neural Representations for Image Compressioncited by 162
- 2021Deep Stable Learning for Out-Of-Distribution Generalizationcited by 153
- 2021BACON: Band-limited Coordinate Networks for Multiscale Scene Representationcited by 143
- 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
- 2021Beyond Periodicity: Towards a Unifying Framework for Activations in Coordinate-MLPscited by 135
- 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
- 2023FINER: Flexible spectral-bias tuning in Implicit NEural Representation by Variable-periodic Activation Functionscited by 78
- 2021ACORN: Adaptive Coordinate Networks for Neural Scene Representationcited by 65
- 2024Bidirectional Multi-Scale Implicit Neural Representations for Image Derainingcited by 54
- 2022NIRVANA: Neural Implicit Representations of Videos with Adaptive Networks and Autoregressive Patch-wise Modelingcited by 51
- 2022Compressing multidimensional weather and climate data into neural networkscited by 31
- 2022DINER: Disorder-Invariant Implicit Neural Representationcited by 30
- 2022Scalable Neural Video Representations with Learnable Positional Featurescited by 29
- 2024DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representationscited by 16
- 2023Accelerating Neural Field Training via Soft Miningcited by 15
- 2024Nonparametric Teaching of Implicit Neural Representationscited by 15
- 2022TINC: Tree-structured Implicit Neural Compressioncited by 14
- 2023Siamese SIREN: Audio Compression with Implicit Neural Representationscited by 13
- 2023Partition Speeds Up Learning Implicit Neural Representations Based on Exponential-Increase Hypothesiscited by 13
- 2024SketchINR: A First Look into Sketches as Implicit Neural Representationscited by 13
- 2023Hypernetworks build Implicit Neural Representations of Soundscited by 11
- 2023Inverting the Imaging Process by Learning an Implicit Camera Modelcited by 10
- 2024Inductive Gradient Adjustment For Spectral Bias In Implicit Neural Representationscited by 8
- 2023In Search of a Data Transformation That Accelerates Neural Field Trainingcited by 7
- 2024Expansive Supervision for Neural Radiance Fieldcited by 5
- 2024Enhancing Implicit Neural Representations via Symmetric Power Transformationcited by 4
- 2023RINAS: Training with Dataset Shuffling Can Be General and Fastcited by 3
Built on by
Citing papers per year: 2025: 3; 2026: 4.
7 papers.
- 2025Optimizing Rank for High-Fidelity Implicit Neural Representationscited by 8
- 2025SD-GS: Structured Deformable 3D Gaussians for Efficient Dynamic Scene Reconstructioncited by 4
- 2025NTK-Guided Implicit Neural Teachingcited by 2
- 2026MesonGS++: Post-training Compression of 3D Gaussian Splatting with Hyperparameter Searchingcited by 0
- 2026Locality-Aware Density Control for Efficient Gaussian-based Image Representationcited by 0
- 2026Efficient Neural Field Learning via Adaptive Coverage and Focused Samplingcited by 0
- 2026Refined Grid Sampling for Efficient Implicit Neural Representations of Large-Scale Scientific Datacited by 0
- 2026Refined Grid Sampling for Efficient Implicit Neural Representations of Large-Scale Scientific Data9 Oct 2026
- 2026Efficient Neural Field Learning via Adaptive Coverage and Focused Sampling1 Oct 2026
- 2026Locality-Aware Density Control for Efficient Gaussian-based Image Representation20 Jul 2026
- 2026MesonGS++: Post-training Compression of 3D Gaussian Splatting with Hyperparameter Searching29 Apr 2026
- 2025Optimizing Rank for High-Fidelity Implicit Neural Representations16 Dec 2025
- 2025NTK-Guided Implicit Neural Teaching19 Nov 2025
- 2025SD-GS: Structured Deformable 3D Gaussians for Efficient Dynamic Scene Reconstruction10 Jul 2025