mlsanityData to 14 Oct 2026

TWIG: A Time-Causal Wavelet Operator for Autoregressive Forecasting on Irregular Graphs

arXiv 2609.22585 ↗First posted 18 Sep 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We introduce TWIG (Time-Causal Wavelet Operator for Irregular Graphs), a graph-native neural operator for autoregressive surrogate modeling on static irregular graphs. TWIG transforms each node history into causal multiscale temporal features that separate recent variation from progressively slower memory components, then propagates these features through graph-wavelet operator blocks with gated pointwise channel mixing. The architecture is causal by construction and designed for closed-loop forecasting, where predictions are recursively reused as future inputs. We evaluate TWIG on three irregular-domain forecasting problems spanning regional diffusion, three-dimensional subsurface hydrology, and aerodynamic flow, with graphs ranging from 400 to 5,233 nodes and model capacities from approximately 70k to 10M parameters. TWIG achieves the lowest aggregate rollout errors on the subsurface-hydrology and regional-diffusion benchmarks and ranks second on the 10M-parameter aerodynamic-flow benchmark, behind the GPS Transformer. Across all three settings, TWIG consistently outperforms the corresponding non-time-causal Graph WNO baseline. These results demonstrate that TWIG provides an effective and scalable approach to stable autoregressive forecasting of dynamical fields on irregular graphs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 46 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

30 of 46 references.

References · 30

  1. 2017Graph Attention Networkscited by 8,923
  2. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  3. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  4. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  5. 2017Decoupled Weight Decay Regularizationcited by 1,831
  6. 2020GLU Variants Improve Transformercited by 1,804
  7. 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
  8. 2020Learning Mesh-Based Simulation with Graph Networkscited by 868
  9. 2021How Attentive are Graph Attention Networks?cited by 835
  10. 2015Scheduled Sampling for Sequence Prediction with Recurrent Neural Networkscited by 803
  11. 2022Recipe for a General, Powerful, Scalable Graph Transformercited by 713
  12. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 631
18 more
  1. 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
  2. 2021Rethinking Graph Transformers with Spectral Attentioncited by 473
  3. 2021Machine learning accelerated computational fluid dynamicscited by 471
  4. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
  5. 2020Multipole Graph Neural Operator for Parametric Partial Differential Equationscited by 349
  6. 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
  7. 2022Long Range Graph Benchmarkcited by 263
  8. 2019Graph Wavelet Neural Networkcited by 131
  9. 2024APEBench: A Benchmark for Autoregressive Neural Emulators of PDEscited by 60
  10. 2019A deep-learning-based surrogate model for data assimilation in dynamic subsurface flow problemscited by 59
  11. 2023Towards Stability of Autoregressive Neural Operatorscited by 59
  12. 2022Efficient Learning of Mesh-Based Physical Simulation with BSMS-GNNcited by 45
  13. 2022Learning Large-scale Subsurface Simulations with a Hybrid Graph Network Simulatorcited by 15
  14. 2023Learning from Predictions: Fusing Training and Autoregressive Inference for Long-Term Spatiotemporal Forecastscited by 11
  15. 2025Synthetic Datasets for Machine Learning on Spatio-Temporal Graphs using PDEscited by 3
  16. 2024GeoFUSE: A High-Efficiency Surrogate Model for Seawater Intrusion Prediction and Uncertainty Reductioncited by 1
  17. 2024Variational Encoder-Decoders for Learning Latent Representations of Physical Systemscited by 1
  18. 2025Time-causal and time-recursive waveletscited by 1

Built on by

Not cited yet.