Prior-Informed Neural Network Initialization: A Spectral Approach for Function Parameterizing Architectures
Not on the map. Why?
Abstract (arXiv)
Neural network architectures designed for function parameterization, such as the Bag-of-Functions (BoF) framework, bridge the gap between the expressivity of deep learning and the interpretability of classical signal processing. However, these models are inherently sensitive to parameter initialization, as traditional data-agnostic schemes fail to capture the structural properties of the target signals, often leading to suboptimal convergence. In this work, we propose a prior-informed design strategy that leverages the intrinsic spectral and temporal structure of the data to guide both network initialization and architectural configuration. A principled methodology is introduced that uses the Fast Fourier Transform to extract dominant seasonal priors, informing model depth and initial states, and a residual-based regression approach to parameterize trend components. Crucially, this structural alignment enables a substantial reduction in encoder dimensionality without compromising reconstruction fidelity. A supporting theoretical analysis provides guidance on trend estimation under finite-sample regimes. Extensive experiments on synthetic and real-world benchmarks demonstrate that embedding data-driven priors significantly accelerates convergence, reduces performance variability across trials, and improves computational efficiency. Overall, the proposed framework enables more compact and interpretable architectures while outperforming standard initialization baselines, without altering the core training procedure.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 30 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
12 of 30 references.
References · 12
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2019N-BEATS: Neural basis expansion analysis for interpretable time series forecastingcited by 753
- 2017Real-valued (Medical) Time Series Generation with Recurrent Conditional GANscited by 333
- 2018Adversarial Audio Synthesiscited by 225
- 2021TimeVAE: A Variational Auto-Encoder for Multivariate Time Series Generationcited by 142
- 2016C-RNN-GAN: Continuous recurrent neural networks with adversarial trainingcited by 132
- 2023Causal Recurrent Variational Autoencoder for Medical Time Series Generationcited by 45
- 2023Improved weight initialization for deep and narrow feedforward neural networkcited by 7
- 2023On the Effect of Initialization: The Scaling Path of 2-Layer Neural Networkscited by 3
- 2025Principal Components for Neural Network Initializationcited by 2
Built on by
Not cited yet.