mlsanityData to 7 Oct 2026

Multi-Scale Temporal Homeostasis Enables Efficient and Robust Neural Networks

arXiv 2602.07009 ↗First posted 30 Jan 2026cs.NE cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Artificial neural networks achieve strong performance on benchmark tasks but remain fundamentally brittle under perturbations, limiting their deployment in real-world settings. In contrast, biological nervous systems sustain reliable function across decades through homeostatic regulation coordinated across multiple temporal scales. Inspired by this principle, this presents Multi-Scale Temporal Homeostasis (MSTH), a biologically grounded framework that integrates ultra-fast (5-ms), fast (2-s), medium (5-min) and slow (1-hrs) regulation into artificial networks. MSTH implements the cross-scale coordination system for artificial neural networks, providing a unified temporal hierarchy that moves beyond superficial biomimicry. The cross-scale coordination enhances computational efficiency through evolutionary-refined optimization mechanisms. Experiments across molecular, graph and image classification benchmarks show that MSTH consistently improves accuracy, eliminates catastrophic failures and enhances recovery from perturbations. Moreover, MSTH outperforms both single-scale bio-inspired models and established state-of-the-art methods, demonstrating generality across diverse domains. These findings establish cross-scale temporal coordination as a core principle for stabilizing artificial neural systems, positioning MSTH as a foundation for building robust, resilient and biologically faithful intelligence.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 39 of its 153 references that are in the map. First posted on arXiv 30 Jan 2026.

Builds on

39 of 153 references.

References · 39

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017Graph Attention Networkscited by 8,854
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
  4. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
  5. 2018Neural Ordinary Differential Equationscited by 3,733
  6. 2020Shortcut Learning in Deep Neural Networkscited by 1,928
  7. 2016Adversarial examples in the physical worldcited by 1,762
  8. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
  9. 2022Diffusion Models in Vision: A Surveycited by 1,008
  10. 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
  11. 2015An Introduction to Convolutional Neural Networkscited by 510
  12. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
27 more
  1. 2017Scalable Training of Artificial Neural Networks with Adaptive Sparse Connectivity inspired by Network Sciencecited by 325
  2. 2018Deep Learning in Spiking Neural Networkscited by 258
  3. 2023The Dormant Neuron Phenomenon in Deep Reinforcement Learningcited by 171
  4. 2020The Early Phase of Neural Network Trainingcited by 114
  5. 2021Neural Flows: Efficient Alternative to Neural ODEscited by 99
  6. 2020Large-scale Robust Deep AUC Maximization: A New Surrogate Loss and Empirical Studies on Medical Image Classificationcited by 84
  7. 2021Is Heterophily A Real Nightmare For Graph Neural Networks To Do Node Classification?cited by 82
  8. 2017Critical Learning Periods in Deep Neural Networkscited by 78
  9. 2016A Boundary Tilting Persepective on the Phenomenon of Adversarial Examplescited by 70
  10. 2024Can we Soft Prompt LLMs for Graph Learning Tasks?cited by 52
  11. 2020Optimization of Graph Neural Networks with Natural Gradient Descentcited by 26
  12. 2018Analyzing biological and artificial neural networks: challenges with opportunities for synergy?cited by 20
  13. 2023Gradual Domain Adaptation: Theory and Algorithmscited by 18
  14. 2019How degenerate is the parametrization of neural networks with the ReLU activation function?cited by 15
  15. 2023Fine-tuning Graph Neural Networks by Preserving Graph Generative Patternscited by 13
  16. 2022Bayesian Continual Learning via Spiking Neural Networkscited by 12
  17. 2022Need is All You Need: Homeostatic Neural Networks Adapt to Concept Shiftcited by 6
  18. 2022Neural mechanisms underlying the temporal organization of naturalistic animal behaviorcited by 4
  19. 2021Edge but not Least: Cross-View Graph Poolingcited by 3
  20. 2024Bio-inspired AI: Integrating Biological Complexity into Artificial Intelligencecited by 3
  21. 2021Constrained plasticity reserve as a natural way to control frequency and weights in spiking neural networkscited by 2
  22. 2022Limitations of neural network training due to numerical instability of backpropagationcited by 2
  23. 2025Integrating Complexity and Biological Realism: High-Performance Spiking Neural Networks for Breast Cancer Detectioncited by 2
  24. 2025Mitigating Catastrophic Forgetting in Continual Learning through Model Growthcited by 2
  25. 2015Constrained Structured Regression with Convolutional Neural Networkscited by 1
  26. 2018Homeostatic plasticity and emergence of functional networks in a whole-brain model at criticalitycited by 1
  27. 2020Controlling network ensemblescited by 1

Built on by

Not cited yet.