mlsanityData to 14 Oct 2026

Scale-Equivariant Generative Forecasting: Weight-Tied Dilated Convolutions, Wavelet Scattering Inputs, and Spectral-Consistency Training for Self-Similar Time Series

arXiv 2605.17582 ↗First posted 17 May 2026cs.LG cs.CEcited by 1

Not on the map. Why?

Abstract (arXiv)

Many natural and engineered time series -- equity returns, climate anomalies, turbulent velocities, neural recordings, packet-level network traffic -- are approximately self-similar: their horizon-T distribution is tied to the horizon-1 distribution by one scaling exponent H. Standard deep generative sequence models (transformers, dilated TCNs, the WaveNet family) ignore this. Their receptive fields are wide, but kernel parameters live independently at every dilation level, yielding a multi-scale architecture, not a scale-equivariant one. We make three contributions. First, we give a precise definition of discrete scale equivariance for 1D causal networks and prove that dyadic dilation commutes (up to boundary effects) with any dilated-convolution stack whose kernel weights are shared across levels. Tying the kernel shrinks the convolutional parameter budget by an L-fold factor (where L is depth) and hard-wires self-similarity in as an inductive bias. Second, we wrap this Scale-Equivariant WaveNet (SE-WaveNet) backbone in three components that carry the same prior: a one-level Daubechies-4 wavelet input, a Hurst-FiLM block exposing the local scaling exponent, and a spectral-consistency training term targeting the |f|-(2H+1) power-law spectrum. The head is a conditional normalising flow, chosen to preserve equivariance. Third, on 30 years of S&P 500 daily log-returns, SE-WaveNet samples reproduce the empirical scaling-collapse diagnostic on the Allan-Variance top-25 universe (median C^star = 0.020), while a vanilla WaveNet at matched capacity does not (≥ 0.06). NLL, KS-calibration, and tail energy distance tie or beat the baseline, with L× fewer convolutional parameters.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 45 references that are in the map. First posted on arXiv 17 May 2026.

Builds on

21 of 45 references.

References · 21

  1. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  2. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  3. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  4. 2016Density estimation using Real NVPcited by 2,042
  5. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  6. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
  7. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  8. 2016Group Equivariant Convolutional Networkscited by 1,165
  9. 2017DeepAR: Probabilistic Forecasting with Autoregressive Recurrent Networkscited by 1,013
  10. 2017Masked Autoregressive Flow for Density Estimationcited by 684
  11. 2018Spherical CNNscited by 456
  12. 2019General E(2)-Equivariant Steerable CNNscited by 446
9 more
  1. 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 337
  2. 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
  3. 2019Deep Scale-spaces: Equivariance Over Scalecited by 114
  4. 2019Scale-Equivariant Steerable Networkscited by 110
  5. 2018Kymatio: Scattering Transforms in Pythoncited by 58
  6. 2013Deep Scattering Spectrumcited by 52
  7. 2017Scaling the Scattering Transform: Deep Hybrid Networkscited by 35
  8. 2020Spatial Frequency Bias in Convolutional Generative Adversarial Networkscited by 35
  9. 2019Scaling-Translation-Equivariant Networks with Decomposed Convolutional Filterscited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.