mlsanityData to 14 Oct 2026

Learning Low Rank Neural Representations of Hyperbolic Wave Dynamics from Data

arXiv 2510.25123 ↗First posted 29 Oct 2025cs.LG cs.AI cs.NAcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a data-driven dimensionality reduction method that is well-suited for physics-based data representing hyperbolic wave propagation. The method utilizes a specialized neural network architecture called low rank neural representation (LRNR) inside a hypernetwork framework. The architecture is motivated by theoretical results that rigorously prove the existence of efficient representations for this wave class. We illustrate through archetypal examples that such an efficient low-dimensional representation of propagating waves can be learned directly from data through a combination of deep learning techniques. We observe that a low rank tensor representation arises naturally in the trained LRNRs, and that this reveals a new decomposition of wave propagation where each decomposed mode corresponds to interpretable physical features. Furthermore, we demonstrate that the LRNR architecture enables efficient inference via a compression scheme, which is a potentially important feature when deploying LRNRs in demanding performance regimes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 108 references that are in the map. First posted on arXiv 29 Oct 2025.

Builds on

31 of 108 references.

References · 31

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2013Intriguing properties of neural networkscited by 5,155
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  6. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  7. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  8. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 2,018
  9. 2018On the Spectral Bias of Neural Networkscited by 1,341
  10. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
  11. 2017Evasion Attacks against Machine Learning at Test Timecited by 689
  12. 2020When and why PINNs fail to train: A neural tangent kernel perspectivecited by 634
19 more
  1. 2018Tune: A Research Platform for Distributed Model Selection and Trainingcited by 395
  2. 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
  3. 2017A Survey of Model Compression and Acceleration for Deep Neural Networkscited by 301
  4. 2014Speeding up Convolutional Neural Networks with Low Rank Expansionscited by 284
  5. 2020Model Reduction and Neural Networks for Parametric PDEscited by 258
  6. 2013Fast Computation of Wasserstein Barycenterscited by 216
  7. 2017Optimal approximation of piecewise smooth functions using deep ReLU neural networkscited by 179
  8. 2020Frequency Bias in Neural Networks for Input of Non-Uniform Densitycited by 140
  9. 2017Optimal Approximation with Sparsely Connected Deep Neural Networkscited by 91
  10. 2021Sharp Bounds on the Approximation Rates, Metric Entropy, and n-widths of Shallow Neural Networkscited by 86
  11. 2019A Theoretical Analysis of Deep Neural Networks and Parametric PDEscited by 74
  12. 2023Hypernetwork-based Meta-Learning for Low-Rank Physics-Informed Neural Networkscited by 44
  13. 2019SoftAdapt: Techniques for Adaptive Loss Weighting of Neural Networks with Multi-Part Loss Functionscited by 40
  14. 2022Neural Implicit Flow: a mesh-agnostic dimensionality reduction paradigm of spatio-temporal datacited by 37
  15. 2020Numerical Solution of the Parametric Diffusion Equation by Deep Neural Networkscited by 27
  16. 2020Exponential ReLU Neural Network Approximation Rates for Point and Edge Singularitiescited by 20
  17. 2024TGPT-PINN: Nonlinear model reduction with transformed GPT-PINNscited by 5
  18. 2024A Low Rank Neural Representation of Entropy Solutionscited by 3
  19. 2024FastLRNR and Sparse Physics Informed Backpropagationcited by 3

Built on by

Not cited yet.