mlsanityData to 7 Oct 2026

Parametric Matrix Models

arXiv 2401.11694 ↗First posted 22 Jan 2024cs.LG cond-mat.dis-nn nucl-thcited by 1

Not on the map. Why?

Abstract (arXiv)

We present a general class of machine learning algorithms called parametric matrix models. In contrast with most existing machine learning models that imitate the biology of neurons, parametric matrix models use matrix equations that emulate physical systems. Similar to how physics problems are usually solved, parametric matrix models learn the governing equations that lead to the desired outputs. Parametric matrix models can be efficiently trained from empirical data, and the equations may use algebraic, differential, or integral relations. While originally designed for scientific computing, we prove that parametric matrix models are universal function approximators that can be applied to general machine learning problems. After introducing the underlying theory, we apply parametric matrix models to a series of different challenges that show their performance for a wide range of problems. For all the challenges tested here, parametric matrix models produce accurate results within an efficient and interpretable computational framework that allows for input feature extrapolation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 123 references that are in the map. First posted on arXiv 22 Jan 2024.

Builds on

20 of 123 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  3. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  4. 2018Neural Ordinary Differential Equationscited by 3,733
  5. 2019Deep Equilibrium Modelscited by 603
  6. 2016Quantum Machine Learningcited by 325
  7. 2017EMNIST: an extension of MNIST to handwritten letterscited by 212
  8. 2019Training Neural Networks with Local Error Signalscited by 135
  9. 2014Dynamic mode decomposition with controlcited by 128
  10. 2019Implicit Deep Learningcited by 124
  11. 2021Combinatorial Optimization with Physics-Inspired Graph Neural Networkscited by 107
  12. 2017Quantum machine learning: a classical perspectivecited by 95
8 more
  1. 2021Efficient-CapsNet: Capsule Network with Self-Attention Routingcited by 41
  2. 2020SpinalNet: Deep Neural Network with Gradual Inputcited by 40
  3. 2019The Convolutional Tsetlin Machinecited by 37
  4. 2018Hybrid Macro/Micro Level Backpropagation for Training Deep Spiking Neural Networkscited by 30
  5. 2018Fenchel Lifted Networks: A Lagrange Relaxation of Neural Network Trainingcited by 18
  6. 2020Fine-Tuning DARTS for Image Classificationcited by 18
  7. 2019Equilibrated Recurrent Neural Network: Neuronal Time-Delayed Self-Feedback Improves Accuracy and Stabilitycited by 2
  8. 2019RNNs Evolving on an Equilibrium Manifold: A Panacea for Vanishing and Exploding Gradients?cited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026The Spectral Neuroncited by 0