Physical Modeling using Recurrent Neural Networks with Fast Convolutional Layers
Not on the map. Why?
Abstract (arXiv)
Discrete-time modeling of acoustic, mechanical and electrical systems is a prominent topic in the musical signal processing literature. Such models are mostly derived by discretizing a mathematical model, given in terms of ordinary or partial differential equations, using established techniques. Recent work has applied the techniques of machine-learning to construct such models automatically from data for the case of systems which have lumped states described by scalar values, such as electrical circuits. In this work, we examine how similar techniques are able to construct models of systems which have spatially distributed rather than lumped states. We describe several novel recurrent neural network structures, and show how they can be thought of as an extension of modal techniques. As a proof of concept, we generate synthetic data for three physical systems and show that the proposed network structures can be trained with this data to reproduce the behavior of these systems.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 7 of its 35 references that are in the map. First posted on arXiv 21 Apr 2022.
Builds on
7 of 35 references.
References · 7
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
- 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
- 2021Neural Operator: Learning Maps Between Function Spacescited by 414
- 2018Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systemscited by 89
- 2018Deep Learning for Tube Amplifier Emulationcited by 18
- 2020wav2shape: Hearing the Shape of a Drum Machinecited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 2; 2025: 3; 2026: 3.
9 papers.
- 2022Modelling black-box audio effects with time-varying feature modulationcited by 11
- 2025Learning to Highlight Audio by Watching Moviescited by 5
- 2024Differentiable Modal Synthesis for Physical Modeling of Planar String Sound and Motion Simulationcited by 4
- 2024Towards Efficient Modelling of String Dynamics: A Comparison of State Space and Koopman based Deep Learning Methodscited by 3
- 2025Fast Differentiable Modal Simulation of Non-linear Strings, Membranes, and Platescited by 3
- 2025Learning Nonlinear Dynamics in Physical Modelling Synthesis using Neural Ordinary Differential Equationscited by 2
- 2026Conditional Flow Matching for Visually-Guided Acoustic Highlightingcited by 1
- 2026Stable Differentiable Modal Synthesis for Learning Nonlinear Dynamicscited by 0
- 2026Identifying the nonlinear string dynamics with port-Hamiltonian neural networkscited by 0
- 2026Identifying the nonlinear string dynamics with port-Hamiltonian neural networks12 May 2026
- 2026Conditional Flow Matching for Visually-Guided Acoustic Highlighting3 Feb 2026
- 2026Stable Differentiable Modal Synthesis for Learning Nonlinear Dynamics15 Jan 2026
- 2025Learning to Highlight Audio by Watching Movies17 May 2025
- 2025Learning Nonlinear Dynamics in Physical Modelling Synthesis using Neural Ordinary Differential Equations15 May 2025
- 2025Fast Differentiable Modal Simulation of Non-linear Strings, Membranes, and Plates9 May 2025
- 2024Towards Efficient Modelling of String Dynamics: A Comparison of State Space and Koopman based Deep Learning Methods29 Aug 2024
- 2024Differentiable Modal Synthesis for Physical Modeling of Planar String Sound and Motion Simulation7 Jul 2024
- 2022Modelling black-box audio effects with time-varying feature modulation1 Nov 2022