mlsanityData to 7 Oct 2026

SILVA Networks as Structured Implicit Layers and Vector Attractors via Dynamic Interaction Fields

arXiv 2607.28989 ↗First posted 31 Jul 2026cs.LG cs.NEcited by 1

Not on the map. Why?

Abstract (arXiv)

Many learning problems require representations that reconcile direct input, nearby structure, and broader context. In implicit neural layers, these influences are usually absorbed into a single fixed-point update, making it hard to identify what enters from the stimulus, what propagates locally, what comes from global context, and what is produced by solver dynamics. Here we introduce SILVA Networks, Structured Implicit Layers and Vector Attractors via Dynamic Interaction Fields. SILVA separates stimulus, local interaction, global interaction, damping, and readout inside one fixed-point architecture. The same template is instantiated for images, molecules, citation networks, and long-range graph benchmarks through domain-specific definitions of nodes, neighborhoods, and global summaries. Experiments and ablations show task-dependent roles for these terms: local interactions are load-bearing in the graph tasks, MNIST gains little from recurrence at the tested capacity, and the clearest global benefit appears in a long-range node-classification benchmark. SILVA therefore provides an implicit representation whose internal interaction dynamics can be trained, ablated, visualized, and diagnosed.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 60 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

31 of 60 references.

References · 31

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2016Layer Normalizationcited by 5,579
  7. 2018How Powerful are Graph Neural Networks?cited by 4,355
  8. 2018Neural Ordinary Differential Equationscited by 3,733
  9. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  10. 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
  11. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  12. 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
19 more
  1. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  2. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  3. 2020Benchmarking Graph Neural Networkscited by 672
  4. 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 624
  5. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
  6. 2019Deep Equilibrium Modelscited by 603
  7. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
  8. 2020Principal Neighbourhood Aggregation for Graph Netscited by 477
  9. 2017Residual Gated Graph ConvNetscited by 341
  10. 2017Stable Architectures for Deep Neural Networkscited by 340
  11. 2016Exponential expressivity in deep neural networks through transient chaoscited by 260
  12. 2020Multiscale Deep Equilibrium Modelscited by 149
  13. 2020Implicit Graph Neural Networkscited by 98
  14. 2021Stabilizing Equilibrium Models by Jacobian Regularizationcited by 71
  15. 2014A Clockwork RNNcited by 70
  16. 2021Attractor and integrator networks in the braincited by 60
  17. 2023Lyapunov-Stable Deep Equilibrium Modelscited by 10
  18. 2025Reversible Deep Equilibrium Modelscited by 5
  19. 2022Graph Perceiver IO: A General Architecture for Graph Structured Datacited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.