mlsanityData to 7 Oct 2026

Neural timescales from a computational perspective

arXiv 2409.02684 ↗First posted 4 Sep 2024q-bio.NC cs.LG stat.MLcited by 3

Not on the map. Why?

Abstract (arXiv)

Neural activity fluctuates over a wide range of timescales within and across brain areas. Experimental observations suggest that diverse neural timescales reflect information in dynamic environments. However, how timescales are defined and measured from brain recordings vary across the literature. Moreover, these observations do not specify the mechanisms underlying timescale variations, nor whether specific timescales are necessary for neural computation and brain function. Here, we synthesize three directions where computational approaches can distill the broad set of empirical observations into quantitative and testable theories: We review (i) how different data analysis methods quantify timescales across distinct behavioral states and recording modalities, (ii) how biophysical models provide mechanistic explanations for the emergence of diverse timescales, and (iii) how task-performing networks and machine learning models uncover the functional relevance of neural timescales. This integrative computational perspective thus complements experimental investigations, providing a holistic view on how neural timescales reflect the relationship between brain structure, dynamics, and behavior.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 48 of its 234 references that are in the map. First posted on arXiv 4 Sep 2024.

Builds on

48 of 234 references.

References · 48

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  2. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  3. 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,447
  4. 2020Long Range Arena: A Benchmark for Efficient Transformerscited by 696
  5. 2021Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layerscited by 607
  6. 2019The frontier of simulation-based inferencecited by 490
  7. 2023Resurrecting Recurrent Neural Networks for Long Sequencescited by 397
  8. 2020Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networkscited by 340
  9. 2022Liquid Structural State-Space Modelscited by 134
  10. 2022What Makes Convolutional Models Great on Long Sequence Modeling?cited by 86
  11. 2019Universality and individuality in neural dynamics across large populations of recurrent networkscited by 61
  12. 2021Attractor and integrator networks in the braincited by 60
36 more
  1. 2018Can recurrent neural networks warp time?cited by 53
  2. 2017Linking connectivity, dynamics and computations in low-rank recurrent neural networkscited by 51
  3. 2019Reverse engineering recurrent networks for sentiment classification reveals line attractor dynamicscited by 38
  4. 2022Tractable Dendritic RNNs for Reconstructing Nonlinear Dynamical Systemscited by 34
  5. 2023Never Train from Scratch: Fair Comparison of Long-Sequence Models Requires Data-Driven Priorscited by 33
  6. 2020Artificial neural networks for neuroscientists: A primercited by 26
  7. 2023Beyond Geometry: Comparing the Temporal Structure of Computation in Neural Circuits with Dynamical Similarity Analysiscited by 21
  8. 2020Theory of gating in recurrent neural networkscited by 19
  9. 2019Gated recurrent units viewed through the lens of continuous time dynamical systemscited by 18
  10. 2023Generalized Bayesian Inference for Scientific Simulators via Amortized Cost Estimationcited by 17
  11. 2024Inferring stochastic low-rank recurrent neural networks from neural datacited by 15
  12. 2020Multi-timescale Representation Learning in LSTM Language Modelscited by 13
  13. 2015Transition to chaos in random neuronal networkscited by 11
  14. 2017Measuring behavior across scalescited by 10
  15. 2023Are Vision Transformers More Data Hungry Than Newborn Visual Systems?cited by 7
  16. 2014Transition to chaos in random networks with cell-type-specific connectivitycited by 6
  17. 2022Contextual guidance: An integrated theory for astrocytes function in brain circuits and behaviorcited by 6
  18. 2023Persistent learning signals and working memory without continuous attractorscited by 6
  19. 2023Emergent mechanisms for long timescales depend on training curriculum and affect performance in memory taskscited by 6
  20. 2023The Expressive Leaky Memory Neuron: an Efficient and Expressive Phenomenological Neuron Model Can Solve Long-Horizon Taskscited by 5
  21. 2023CORNN: Convex optimization of recurrent neural networks for rapid inference of neural dynamicscited by 5
  22. 2020From univariate to multivariate coupling between continuous signals and point processes: a mathematical frameworkcited by 4
  23. 2021Cluster-based Input Weight Initialization for Echo State Networkscited by 4
  24. 2023Theory of coupled neuronal-synaptic dynamicscited by 4
  25. 2019A Microscopic Theory of Intrinsic Timescales in Spiking Neural Networkscited by 3
  26. 2018Dynamic Adaptive Computation: Tuning network states to task requirementscited by 2
  27. 2018How single neuron properties shape chaotic dynamics and signal transmission in random neural networkscited by 2
  28. 2022Spatial and temporal correlations in neural networks with structured connectivitycited by 2
  29. 2017Decline of long-range temporal correlations in the human brain during sustained wakefulnesscited by 1
  30. 2018Contrasting the effects of adaptation and synaptic filtering on the timescales of dynamics in recurrent networkscited by 1
  31. 2020MR. Estimator, a toolbox to determine intrinsic timescales from subsampled spiking activitycited by 1
  32. 2020Searching for long time scales without fine tuningcited by 1
  33. 2022Autocorrelations from emergent bistability in homeostatic spiking neural networks on neuromorphic hardwarecited by 1
  34. 2022Topology-dependent coalescence controls scaling exponents in finite networkscited by 1
  35. 2023Long time scales, individual differences, and scale invariance in animal behaviorcited by 1
  36. 2023Signatures of hierarchical temporal processing in the mouse visual systemcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.