Training all-mechanical neural networks for task learning through in situ backpropagation
Not on the map. Why?
Abstract (arXiv)
Recent advances unveiled physical neural networks as promising machine learning platforms, offering faster and more energy-efficient information processing. Compared with extensively-studied optical neural networks, the development of mechanical neural networks (MNNs) remains nascent and faces significant challenges, including heavy computational demands and learning with approximate gradients. Here, we introduce the mechanical analogue of in situ backpropagation to enable highly efficient training of MNNs. We demonstrate that the exact gradient can be obtained locally in MNNs, enabling learning through their immediate vicinity. With the gradient information, we showcase the successful training of MNNs for behavior learning and machine learning tasks, achieving high accuracy in regression and classification. Furthermore, we present the retrainability of MNNs involving task-switching and damage, demonstrating the resilience. Our findings, which integrate the theory for training MNNs and experimental and numerical validations, pave the way for mechanical machine learning hardware and autonomous self-learning material systems.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 19 of its 62 references that are in the map. First posted on arXiv 23 Apr 2024.
Builds on
19 of 62 references.
References · 19
- 2015Automatic differentiation in machine learning: a surveycited by 855
- 2017Efficient Processing of Deep Neural Networks: A Tutorial and Surveycited by 434
- 2016Equilibrium Propagation: Bridging the Gap Between Energy-Based Models and Backpropagationcited by 259
- 2020The Computational Limits of Deep Learningcited by 193
- 2018All-Optical Machine Learning Using Diffractive Deep Neural Networkscited by 177
- 2021Deep physical neural networks enabled by a backpropagation algorithm for arbitrary physical systemscited by 128
- 2020Photonics for artificial intelligence and neuromorphic computingcited by 112
- 2019Theoretical Issues in Deep Networks: Approximation, Optimization and Generalizationcited by 72
- 2020Training End-to-End Analog Neural Networks with Equilibrium Propagationcited by 63
- 2018Training of photonic neural networks through in situ backpropagationcited by 45
- 2022Experimentally realized in situ backpropagation for deep learning in nanophotonic neural networkscited by 44
- 2019Wave Physics as an Analog Recurrent Neural Networkcited by 43
7 more
- 2021An optical neural network using less than 1 photon per multiplicationcited by 30
- 2023Training an Ising Machine with Equilibrium Propagationcited by 29
- 2024Training Coupled Phase Oscillators as a Neuromorphic Platform using Equilibrium Propagationcited by 16
- 2022Learning by non-interfering feedback chemical signaling in physical networkscited by 11
- 2014Trainable and Dynamic Computing: Error Backpropagation through Physical Mediacited by 9
- 2022Desynchronous Learning in a Physics-Driven Learning Networkcited by 5
- 2019Meta-neural-network for Realtime and Passive Deep-learning-based Object Recognitioncited by 4
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 3.
5 papers.
- 2024Quantum Equilibrium Propagation: Gradient-Descent Training of Quantum Systemscited by 10
- 2025Analog Physical Systems Can Exhibit Double Descentcited by 0
- 2026Laser interferometry as a robust neuromorphic platform for machine learningcited by 0
- 2026Perturbative Contrastive Physical Learningcited by 0
- 2026RAOA: Alternating-Operator Neural Computation with Programmable Radio Propagationcited by 0
- 2026RAOA: Alternating-Operator Neural Computation with Programmable Radio Propagation2 Oct 2026
- 2026Perturbative Contrastive Physical Learning8 Jun 2026
- 2026Laser interferometry as a robust neuromorphic platform for machine learning26 Jan 2026
- 2025Analog Physical Systems Can Exhibit Double Descent21 Nov 2025
- 2024Quantum Equilibrium Propagation: Gradient-Descent Training of Quantum Systems2 Jun 2024